Terminé

Remove and encrypt keys and values on 15GB JSON file (from bz2) - 10/01/2020 16:45 EST

I have a 15GB files in BZ2. I need them first converted into JSON format (they aren't yet marked as JSON), using the following linux/unix commands (my computer doesn't have enough space to do it) after the tar ball has been extracted just through double click:

Move all export subfiles into one folder

find . -name \*.bz2 -exec cp {} ../target \;

Unzip them to (unmarked) JSON

cd target

find . -type f -exec bzip2 -d {} + (if too large)

Bringing JSON into one file

cat * > [login to view URL]

This massive array of values follows a fairly standard structure - but isn't quite JSON yet.

Giving export valid JSON commas:

tr '\n' ‘,\n’ < [login to view URL] > [login to view URL]

Add JSON array elements to start and end of file

echo “[” >> [login to view URL]

cat [login to view URL] >> [login to view URL]

echo “]” >> [login to view URL]

THE ABOVE WILL TAKE SOME COMPUTE POWER/TIME AS ITS A MASSIVE FILE.

Then, you should be left with a format like the attached picture.

From here, kindly scramble the names of all keys in a standard way (i.e. they're all the same) and give me the translations in a separate text file.

For the "bettingType", "marketType", "name" and "eventName" elements, please scramble the VALUES in a standard way also. There are "name" elements at two different levels, please scramble both.

As well as the translation file, please provide me with the code you used to do the above. As with the text transformations, it will take a while as its a large file.

Then send it back to me via your preferred means - zip whatever, as long as the file within stays the same.

Compétences : Traitement de Données, Python, Linux, Administration de Bases de données

en voir plus : jquery remote json file, extjs json file, extjs datagrid blank local json file, jquery select load json file, jquery json file, create json file html, make json file, reading values web xml file flex, remove html tags html code text file ruby, saving html data json file, create table json file, json file format, json file, json file import mysql, create json file format, php import json file

Concernant l'employeur :
( 8 commentaires ) CASTLEBAR, Ireland

Nº du projet : #23322703

Décerné à:

ArleMedina

Hello sir, I am a DevOps Engineer that uses json parsing tools regularly to transform json files. I will use the jq bash command tool to parse your files according to your requirements

%selectedBids___i_sum_sub_7% %project_currencyDetails_sign_sub_8% EUR en 2 jours
(59 Commentaires)
5.4

10 freelance font une offre moyenne de €159 pour ce travail

unix515

I am a python expert and I am very familiar with data processing. I am so interested in your project. Please contact me and discuss more so that I can deliver this job.

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 2 jours
(12 Commentaires)
4.7
goodwork20k

I am good in powershell, json along with automation and development Are you ok with windows powershell? if you are ok please provide some sample input file I will make a powershell script to convert normal text file Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 7 jours
(8 Commentaires)
3.7
tamas421

I am interested in the task. Related experiences: Linux / bash. Awaiting of your kind reply in case of possible selection.

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% EUR en 1 jour
(8 Commentaires)
2.6
zaidur101

Hello there! I have carefully gone through your job post and understood your requirements. I am offering you my quality service. You can check my profile & portfolio for details about my experiences. If you give me th Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 7 jours
(2 Commentaires)
1.2
Rachitkum55

i am expert in python i have almost about 2 year experience as Python Developer i did lots projects on python dill completed dead lines of projects on time i really serious about my responsibilities and work towards my Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 7 jours
(2 Commentaires)
1.3
furqan224

i read your project and understand your requirements. i can complete this task because i have big RAM memory in my system and big computation power. i have experience in script writing send me message so we i can start Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 2 jours
(1 Évaluation)
0.4
GogolevMax1

Dear I have read your description carefully to get a clear understanding of what you want and what I should achieve. Now I want to say that I am really interested in your task and I can do it successfully. I have be Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 7 jours
(0 Commentaires)
1.0
zhuai

Hello I have read your description with care. I can complete your job. I have rich experience like that before. Your project is very fit to my skills. If you would award it to me, I am confident that I can complete thi Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 7 jours
(1 Évaluation)
0.0
manuelleal

Hello... i can help you with that. Can't give an accurate delivery date due to the nature of the task, but i'll be using a good hardware setup for it... please send a message and give some more details, and we can tal Plus

%bids___i_sum_sub_35% %project_currencyDetails_sign_sub_36% EUR en 7 jours
(0 Commentaires)
0.0