php - How to do monthly refresh of large DB tables without interrupting user access to them -

-

In the Oracle Database I have four DB tables which need to be rewritten / refreshed every week or every month. I am using this script standard PHP OCI functions in PHP, which reads new data from XML and refreshes these four tables. The four tables have the following properties

Table A - up to 2mil rows, one primary key (one row can contain up to 2K data)

Table B - up to 10mil rows, a table A foreign key indicating A (the data can take up to 1100 bytes in a row)

Table C - Up to 10 millimeter rows, a foreign key indicating Table A (Maximum of one line data 1100 bytes may take)

Table D - 10mil row To the extent, a foreign key leading to Table A (maximum 120 bytes in a row)

So I need recapitalization without damaging these tables User Experience I can not explicitly remove the tables and only offer them again because it is a somewhat long process.

I have only considered a big transaction where I remove from all the tables and rebuild them. I am a bit worried about the length of the transaction (I do not know yet, but it has an hour or so May take longer)

I wanted to create temporary table replicas of all tables. Then I could remove the main tables and rename the temporary tables. Although you can not make DROP and optional table descriptions within the transaction because they always auto commit. It can be done quickly (four DROP and four optional table descriptions), but can not guarantee that the user will not get any errors in that short time.

Now, a combination of two ideas, I am considering floating tables, then to reconstruct the main tables, all the four basic tables from the floating tables and later a delete from INSERT Since there is no DDL statement here, it will work within all transactions. Again, however, I am thinking that there are some 60 million records processing mechanisms within the transaction (I think this would be a concern for the first consideration).

It would be a normal scenario, is there a standard or recommended way of doing this? Any tips would be appreciated. Thank you.

Am I the only one (except Vincent) that would be possible first possible solution , i.e. Daily / INSERT, before trying to make something more advanced?

Again, I am thinking that if the memory processing process of some 60 million records within the transaction is causing me trouble (this would be a concern for the first thought).

Oracle manages memory very well, it has not been written by a group of Java novices (oops, it came out of my mouth!). So the real question is whether you need to worry about the performance penalties of the RDO and UNDO log files ... In other words, make a demonstration test case and run it on your server and see how long it takes is. During DELETE / INSERT the system will not be normally liable, but other sessions can still be selected without fear of deadlock, memory leaks or system crashes. Indications: DB servers are usually disk-bound, so getting a proper RAID orange is usually a very good investment.

On the other hand, if performance is important, you can choose one of the alternate methods described in this thread:

  • Partitions if you have a license
  • Changing the name of the table if you do not, but be careful that DDL on the flight can cause some side effects object invalid, ORA-06508 ...

Comments

Post a Comment

Popular posts from this blog

c++ - Linux and clipboard -

-
After selecting the copies of the buffer in Linux, after the text, we can click and paste the button between the mouse. I think there is a special buffer for this, I want to use it. Programming Language: C ++ Your Library: Qt Thanks. There is just one more correct answer than Paul Dixon, which answers your needs: / P > QClipboard * clipboard = QApplication :: clipboard (); CastString Selected Text = Clipboard-> Text (QClipboard :: Selection);
Read more

What is expire header and how to achive them in ASP.NET and PHP? -

-
I have examined the performance statistics of my website today. I have received a warning (or error may occur) that is given below Add Terminal Headers Here are 15 static components without a 15-futures end date * (no end) Http://www.example.com/video/css/global.css * (no time limit) http://www.example.com/video/js/global.js * (no expiration ) Http: //www.example.com/video/images/main-bg.png what it means and how to achieve it both in PHP and ASP.Net. I am on a shared hosting server, so please tell me some ways to use the code, because I can not make any modifications at the end of the server. If I expire the header, then there is no chance that if I make changes to the CSS, then the user will not be able to remove them immediately because CSS and other files have a fixed time limit (1 month, week ) Are cached for. Is Is there any harm to using PHP? $ time = time () + 3 * 24 * 60 * 60; // 3 day headings ('End:'. GMDAT ('D, D MYH: i: s \ g \ m \ t',
Read more

sql server - How can I determine which of my SQL 2005 statistics are unused? -

-
After a few years, one of my biggest databases has deposited 73 figures out of its largest tables. With Indexes, I can run many types of reports and queries, how often / heavily specific indexes are used. What is an equivalent for data? We are running SQL 2005. To make statistics automatically managed and honest, I would like to "update statistics", "create statistics" and There is no information about any management except "drop statistics" orders. In theory, UPDATE should handle the addition and removal of statistical data. In addition, I've never heard about the amount of storage or storage taking in large amounts, so I'm not sure whether there is any reason for the alarm or not. If you are seeing a potential problem, then I would suggest running an update before, if it does not clean it, it is leaving and then it appears to be safe operation (because it is the only query optimizer Is for). I will not leave "left" in the
Read more