java - efficient algorithm to compare similarity between sets of numbers? -

-

I have a large number of numbers, each set has 10 numbers and I need to delete all those set whose Near 5 or more numbers (unroded) matches are from any other set.

For example: 

  set 1: {12,14,222,998,1,89,43,22,7654,23} set 2: {44,23,64 , 76,987,3,2345,443,431,88} set 3: {998,22,7654,345,112,32, 89,9842,31,23}

above the set number of 10 Looking at the 3 set and Set 3 will be considered a duplicate because they have 5 mail numbers, in this case I will delete set 3 (because it is considered equal to 1 set).

I have more than 10000 sets to compare and I want to do it very efficiently. I'm ending it and I can not think of it in an efficient manner (it would be good to do this at a single pass).

Any ideas? Thanks!

Mike

You should reconsider your requirements because it is in operation Also, do not have a well-defined result, for example, set this: 

  set 1: {1, 2, 3, 4, 5, 6, 7, 8, 9, 10 } Set 2: {6, 7, 8, 9, 10, 11, 12, 13, 14, 15} Set 3: {11, 12, 13, 14, 15, 16, 17, 18, 19, 20} / Code>

If you consider 1 and 2 for the first time as "duplicate" and finish 1 set, then 2 and 3 are also "duplicate" and you only have one set Going live Are there. But if you eliminate 2 sets instead, 1 and 3 do not have any matches and you have two sets remaining.

You can easily extend it to your 10,000 sets so that it can be possible that at which you compare and finish first, you can leave only one set or with 5000 sets. . I do not think you want what you want.

Your problem is that you are trying to find, but you do not use "equality" to define the relationship. Specifically, it is not transitive to the common man's condition, if set A is "equal" to set "set" and set to "set" to set C, then your definition is not sure Does that also have "equal" to A, and so you can not end the same set.

Before you are worried about an efficient implementation, you need to first clarify your needs to deal with this problem. Either find a way to define a traditional similarity, or keep all the sets and only work with comparisons (or with a list of sets equal to each single set).


Comments

Post a Comment

Popular posts from this blog

c++ - Linux and clipboard -

-
After selecting the copies of the buffer in Linux, after the text, we can click and paste the button between the mouse. I think there is a special buffer for this, I want to use it. Programming Language: C ++ Your Library: Qt Thanks. There is just one more correct answer than Paul Dixon, which answers your needs: / P > QClipboard * clipboard = QApplication :: clipboard (); CastString Selected Text = Clipboard-> Text (QClipboard :: Selection);
Read more

What is expire header and how to achive them in ASP.NET and PHP? -

-
I have examined the performance statistics of my website today. I have received a warning (or error may occur) that is given below Add Terminal Headers Here are 15 static components without a 15-futures end date * (no end) Http://www.example.com/video/css/global.css * (no time limit) http://www.example.com/video/js/global.js * (no expiration ) Http: //www.example.com/video/images/main-bg.png what it means and how to achieve it both in PHP and ASP.Net. I am on a shared hosting server, so please tell me some ways to use the code, because I can not make any modifications at the end of the server. If I expire the header, then there is no chance that if I make changes to the CSS, then the user will not be able to remove them immediately because CSS and other files have a fixed time limit (1 month, week ) Are cached for. Is Is there any harm to using PHP? $ time = time () + 3 * 24 * 60 * 60; // 3 day headings ('End:'. GMDAT ('D, D MYH: i: s \ g \ m \ t',
Read more

sql server - How can I determine which of my SQL 2005 statistics are unused? -

-
After a few years, one of my biggest databases has deposited 73 figures out of its largest tables. With Indexes, I can run many types of reports and queries, how often / heavily specific indexes are used. What is an equivalent for data? We are running SQL 2005. To make statistics automatically managed and honest, I would like to "update statistics", "create statistics" and There is no information about any management except "drop statistics" orders. In theory, UPDATE should handle the addition and removal of statistical data. In addition, I've never heard about the amount of storage or storage taking in large amounts, so I'm not sure whether there is any reason for the alarm or not. If you are seeing a potential problem, then I would suggest running an update before, if it does not clean it, it is leaving and then it appears to be safe operation (because it is the only query optimizer Is for). I will not leave "left" in the
Read more