I have a python tool that allows me to create mass landing pages from a spreadsheet.
I want to be able to create 200k+ pages from a spreadsheet with 200k+ rows within an hour or a few hours. And I want to be able repeat the process without slowing down the server or database. I have more than 1,000 spreadsheets and each has more than 200k rows in them.
However, it takes more than 24 hours to create 50k pages.
The problem is that once I upload a spreadsheet in the frontend of the tool, it takes about an hour to create the first 10k pages. After that, the next hour will be around 2k pages, next hour will be around 200 pages, and so on. I even tried a spreadsheet with just 6k rows, but that didn't work either. It took more than an hour to create the first 500 pages and the next hour was like 100 pages.
The tool is hosted on DigitalOcean using droplet. I've tried several droplet upgrades and even switched to using AWS RDS [login to view URL], nothing worked.
4 freelances font une offre moyenne de 28 $ pour ce travail
Hey there, I am interested in your project. Let's discuss more over chat. "I can start work right away" Thanks for looking forward to my proposal.
Hi, I have relevant experience of 5 years in AI, python, ethereum, solidity smart contract and have done similar work in the past. I have experience with nodejs, AWS ec2, [login to view URL] me know if I can help you with it.