Find Jobs
Hire Freelancers

SQLite database and Python Query for Email subscriber database - SQLite3

$10-30 USD

Complété
Publié il y a plus d’un an

$10-30 USD

Payé lors de la livraison
I am looking for someone that can make a SQLite database the requirements are as follows: I would like the script to be broken into 3 smaller scripts. All scripts, output database, CSV/TXT files will all be in the same path. Script part 1 - Building the database 1, Database name 'Main_Database' (there will only be 1 db) 2, Table name 'user_data' (there will only be 1 table in the database) 3, The table will have 1 column 'Email_address'. 4, Must Create Unique index on 'user_data' (Email_address) [The DB will hold a lot of data so want searching to be as fast as possible] Script part 2 - Input data to the database I want to be able to add data periodically to the database from .txt and .csv files. The data will always be in this format. EmailAddress:SubscriberType. Only insert unique values to the table and only insert text in to the column before the first instance of ":". The unique value is based upon the EmailAddress. 5, Insert values of this sheet into the database built in 'Script 1' ensuring that there are no duplicates added based on the EmailAddress. 6, The files will be either CSV or TXT, Email address and Subscriber type will be separated by a : 7, I only need to upload 1 file at a time. I want it to update the database and not create a new one each time. The files are large and it should insert 100,000 at a time. if(count % 10000 == 0): Script part 3 - Script to query the database. I would like to be able to query the database in 3 ways. I only wish to query EmailAddress. There is no need to query SubscriberType. 1st method - Exact match of email address. Only display the results that are the exact match of the email address 2nd method - like. Partial match based on 1 word. For example if there are 4 email addresses in the database as below and I query 'ho' I want it to return 2 results. 'hot_chocolate@gmai' and 'hot_toffee@outl' hot_chocolate@gmai green_wren_spotter@hotm Hamptonlife@yaho hot_toffee_chocolate@outl 3rd method - basic boolean search using AND. Partial match based on 2 words appearing anywhere in the Email_address. For example if there are 4 email addresses in the database as above and I query 'hot' and 'choc' I want it to return 1 result(s). 'hot_chocolate@gmai'. These results will display in the terminal window and say Press * Key to export results to CSV/TXT file. It will then generate a unique text file and save in the folder. Other requirements: - Most importantly this db will hold a vast amount of data. It must therefore be able to upload to the database quickly (Less than 3 minutes per 1,000,000) and query the data quickly (Less than a few seconds per query) - I have 3 script that have been made but the upload and query becomes very slow when the database gets to 10,000,000. I can share the scripts with you hence the new project. - This will run on Ubuntu 20.04 - Should be delivered in 3 .py files not all together in 1 file - To be made in SQLite (If you have any better ideas of where to build this, I am open to suggestions).
N° de projet : 35197133

Concernant le projet

12 propositions
Projet à distance
Actif à il y a 1 an

Cherchez-vous à gagner de l'argent ?

Avantages de faire une offre sur Freelancer

Fixez votre budget et vos délais
Soyez payé pour votre travail
Surlignez votre proposition
Il est gratuit de s'inscrire et de faire des offres sur des travaux
Décerné à :
Avatar de l'utilisateur
Hello, I am an experienced Python Software Developer proficient in SQLite. I have successfully completed multiple projects in Python using the SQLite database, and I can write Python scripts for quering SQLite email subscribers database
$20 USD en 7 jours
5,0 (22 commentaires)
4,7
4,7
12 freelances proposent en moyenne $72 USD pour ce travail
Avatar de l'utilisateur
Hello sir, I am a database admin and I am very familiar with SQLite and Python. I can do this project as required in time. Kindly contact me to discuss more. Best regards,
$20 USD en 1 jour
5,0 (32 commentaires)
5,4
5,4
Avatar de l'utilisateur
Hello, there? This is Eduardo from Australia. I am happy to bid to your project. I have good experience in Python, SQL Server, SQLite3. I have understood what you want to do. I can deliver good result in short time. Hope to work with you for the project. Thank you.
$220 USD en 7 jours
4,9 (41 commentaires)
5,8
5,8
Avatar de l'utilisateur
Hello, I have rich experience in Python coding on SQLite for designing and managing DB. I have read all your explanations carefully and fully understand your requirements. So I am sure I can give you correct and good results. I would appreciate it if you could contact me soon and share your project details. Thank you.
$20 USD en 7 jours
5,0 (7 commentaires)
4,4
4,4
Avatar de l'utilisateur
Hi! I am interested in your project because I am python & SQL expert. I am available any time you want. If you want to work with me, reply to me. Thanks.
$20 USD en 1 jour
5,0 (8 commentaires)
3,8
3,8
Avatar de l'utilisateur
Hi, I am interested with your project. I would like to discuss it with more details. Hope to hear from you soon.
$100 USD en 2 jours
4,4 (9 commentaires)
3,8
3,8
Avatar de l'utilisateur
Your project looks interesting, maybe I can help. I've made Python utilities and tools for backend support in systems I've developed. I think using SQLite for your project is overkill, so I'll take your offer to entertain another plan. Performance-wise, I think using a plain text system file as the emails store is the best option. In order to handle updates and search, I would keep the emails file sorted. New emails insertion would be made by a simple merge. Scripting should be required to filter out separators and non-email text from the ':' on. The new emails set needs to be sorted before merging, but if the relative size (on the order of a hundred thousand, as you say) of this set is small this could be tolerable. Exact value and left hand part of a key queries should be fast enough, using a binary search algorithm. Finding keys in arbitrary positions will require reading the whole file, no way to avoid this. The query and results export functionality requires a custom script, or maybe your existing version can be adapted. I think your scalability requirement will be covered by this proposal, but I can write a POC to show you the processing times. Let me hear if you're interested by dropping me a line thru Chat. Thank you for your attention.
$40 USD en 4 jours
5,0 (4 commentaires)
1,6
1,6
Avatar de l'utilisateur
Having good industry experience as Python developer. Lets connect and discuss further
$15 USD en 3 jours
0,0 (0 commentaires)
0,0
0,0

À propos du client

Drapeau de CHINA
Beijing, China
5,0
62
Méthode de paiement vérifiée
Membre depuis nov. 20, 2012

Vérification du client

Merci ! Nous vous avons envoyé un lien par e-mail afin de réclamer votre crédit gratuit.
Une erreur a eu lieu lors de l'envoi de votre e-mail. Veuillez réessayer.
Utilisateurs enregistrés Total des travaux publiés
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Chargement de l'aperçu
Permission donnée pour la géolocalisation.
Votre session de connexion a expiré et vous avez été déconnecté. Veuillez vous connecter à nouveau.