Terminé

Large text files comparison

I need a solution to compare 2 large text files (4-6 gb / 200-300 millions lines each) and save the unique lines to another text file.

Example :

[login to view URL]

With "Display Uniques Per List" option checked.

I'd prefer using windows command line but I'm opened to all suggestions.

Compétences : Programmation C, DOS, Perl, Powershell, Python

en voir plus : large excel files, excel large data files, vbscript process text files, vbscripts text files, create html files text files, mysql database hold text files, translate text files spanish, excel macros create text files excel, search text files report java, java file parser find text files, parse large text files java, comparison text files, perl code external comparison text files, translate large text files, merging large text files vbnet, processing large text files classic asp, how to import large text files into access, create large text files

Concernant l'employeur :
( 68 commentaires ) lyon, France

Nº du projet : #20046300

Décerné à:

alexharrison1990

Several years experience writing scripts to do precisely this type of task for digital forensics and legal applications. Happy to provide a Windows command line or GUI utility

%selectedBids___i_sum_sub_4% %project_currencyDetails_sign_sub_5% EUR en 1 jour
(0 Commentaires)
0.0

19 freelance font une offre moyenne de €32 pour ce travail

ineedWorkJob

Greetings sir, I have read your project details and i will develop a command line tool compare your 2large file and export unique lines into new text file. Sir, i can deliver this project sooner than you expect a Plus

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(93 Commentaires)
6.3
jap2013

Hi, I can build a small windows application for file comparison and unique content extraction. we can discuss this further. thanks

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(7 Commentaires)
5.2
kunitsynartem

Hello! I can write you Python script that will compare those 2 large textfiles and create 3rd with unique lines. It's a quick job.

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(17 Commentaires)
5.0
goodwork20k

I am good in perl along with file/data handling, please let me know if you are good to award this project to me

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 2 jours
(11 Commentaires)
4.0
bluetiger12

hi, dear. how do you do . i read your description. i have some experiences of c programming. you can discuss your project with me more detail via chat. please contact me. kindly regards.

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(18 Commentaires)
3.8
origami07

Hello, I have been developing scripts in the python environment for many years. I can complete your projecting dealing with all things python. I must have a milestone created and complete specifications sent before i Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 7 jours
(10 Commentaires)
3.8
notgreen

Dear Sir ! Use my perl script ,run from command prompt :usage : perl [login to view URL] file1 file2 >[login to view URL] copy the following lines to [login to view URL] use strict; my $f1= $ARGV[0]; my $f2= $ARGV[1]; my Plus

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(5 Commentaires)
2.7
adamwalton1

There is a very simple way of completing your project message me and we can be done in a couple of minutes.

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(2 Commentaires)
1.9
lesula

I am an expert in perl. I can finish this task in 15 minutes. Contact me.

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(4 Commentaires)
1.7
khabibki06

Dear, I am lecturer at Department of Chemistry and have many experience in c++ and windows scripting. Your files are large, so I recommend you to using small windows app rather than windows commands. The performance o Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 2 jours
(1 Évaluation)
0.7
krunal921

Hi i have plan to do it. But can you provide me the sample of both the files as it would be more helpful for creating solution.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 3 jours
(0 Commentaires)
0.0
snowman718718

Dear Sir. Thanks for your job posting. I saw your description very carefully. So I understood fully what you want. So I think your project is very suitable for me. I am so independent and I can devote only your job. Plus

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(0 Commentaires)
0.0
estebansalpeter

Hi! These are the projects where size matters!! We can do it with a python script, which can run under windows or linux. Let's chat to define well the scenario of the file handling and let's do it! Best regards, E Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 2 jours
(0 Commentaires)
0.0
maraTony

Le programme est facile à faire. Je me demande juste quels sont les contraintes matérielles (mémoire ram et vitesse d'exécution).

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(0 Commentaires)
0.0
muchiprods

Hello! I have a perl one-liner that would do this fast enough by using standard perl modules and the windows command line.

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(0 Commentaires)
0.0
rounak316

Will write a script , which will do the job. Focus wil be on performance. It will hardly take 2 houts. Would wait for your reply. I can provide Windows/Linux/UI tool, that will help you analyse the result.

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(0 Commentaires)
0.0
wulongzhu87

Hi there! My name is Longzhu and I’m a professional developer with 7+ years of experience. I'm honesty, communicable, responsible and passionate about web programming holding my hand on a pulse of a new technologies e Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 7 jours
(0 Commentaires)
0.0
hdanijel94

I've done many projects with files. You will get - maximum simplicity, efficiency and easy-to-use program. Command line or .exe file or something else - your choice

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 2 jours
(0 Commentaires)
0.0