
Closed
Posted
Paid on delivery
Python Developer Needed: Multi-User Web Scraping & Lead Generation Platform (Django, Celery, PostgreSQL) Post: We are building a secure, multi-user web platform that collects business and recruitment data from public sources and delivers clean, ready-to-use records to each user. What the platform does: Collects data from job portals and other public business sources Cleans and standardizes phone numbers and emails Blocks duplicate records Exports to Excel and Google Sheets Includes a user dashboard and an admin panel You should have: Strong Python experience (Django or FastAPI) Proven web scraping experience, including dynamic sites and anti-bot handling Experience with Celery, Redis and PostgreSQL Experience with multi-user or SaaS-style architecture Comfort deploying on a client-owned cloud server Project details: Milestone-based delivery, with a live walkthrough after each milestone All code goes to our private repository and all infrastructure stays on our own servers Detailed technical specification shared with shortlisted candidates only Start your bid with the code word TM-HARVEST-31. Bids without it will not be reviewed. To apply, please include: Examples of similar scraping or data platforms you have built Your proposed approach and timeline for the first milestone Your availability and fixed-price quote
Project ID: 40752727
172 proposals
Remote project
Active 1 min ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
172 freelancers are bidding on average $172 USD for this job

⭐⭐⭐⭐⭐ Multi‑User Web Scraping & Lead Generation Platform with Django ❇️ Hi My Friend, I hope you are doing well. I checked all of your project requirements and I can see you are looking for a Python developer. You have no need to look any further as Zohaib is here to help you! My team is already doing 50+ similar projects for SaaS data platforms. TM-HARVEST-31 I will build the platform with Django, Celery and PostgreSQL, using Redis for task queues and anti‑bot techniques for dynamic sites. I will also set up clean data pipelines, duplicate blocking and Excel/Google Sheets export within the same budget. ➡️ Why Me? I can easily do your platform as I have 5 years of experience in Python, Django, Celery, Redis, PostgreSQL, web scraping, API integration, data cleaning, SaaS architecture. Not only this, I have a strong grip on Docker deployment, Nginx and cloud servers. ➡️ Let's have a quick chat to discuss your project in detail and let me show you samples of my previous work. Looking forward to discussing with you in chat. ➡️ Skills & Experience: ✅ Python ✅ Django ✅ Celery ✅ Redis ✅ PostgreSQL ✅ Web Scraping ✅ Anti‑Bot Handling ✅ Data Cleaning ✅ SaaS Architecture ✅ Docker ✅ Nginx ✅ Cloud Deployment Waiting for your response! Best Regards, Zohaib
$150 USD in 2 days
8.0
8.0

TM-HARVEST-31 Hello, I checked your project and understand you need a secure Django SaaS platform for multi-user scraping, lead cleaning, deduplication, and exports. I have built similar scraping systems using Python, Django, Celery, Redis, PostgreSQL, Puppeteer, Selenium, Scrapy, and AdsPower, including large Google Maps datasets and dynamic websites. For the first milestone, I’d set up the private repository, server environment, user roles, scraping task structure, Celery queues, and PostgreSQL data model, followed by a live walkthrough. I’ll use normalization rules for phone numbers and emails, database constraints for duplicate prevention, and controlled workers for reliable scraping and anti-bot handling. Exports can be prepared for Excel and Google Sheets, with Elasticsearch added where fast lead searching is needed. I can also provide the fixed-price milestone proposal through Freelancer.com after reviewing the technical specification. Could we discuss the target sources, expected record fields, and the first milestone acceptance criteria? Best regards
$999 USD in 10 days
7.6
7.6

TM-HARVEST-31 You need a multi-user platform that scrapes job portals and business directories, cleans contact data, blocks duplicates and lets each user export their own leads without overlap or downtime. I have built trading platforms with real-time data pipelines, background task queues and multi-user dashboards, so I understand how to structure a system where many users trigger scraping jobs concurrently without blocking each other. I would use Django for the API and user management, Celery with Redis for queuing scrape tasks per user, PostgreSQL for storing leads with indexed deduplication checks, and libraries like Playwright or Selenium when sites require JavaScript rendering. For anti-bot handling I rotate proxies and user agents and add random delays. The admin panel would track scrape jobs, user quotas and system health, and exports would generate asynchronously so the UI stays responsive. I have a 4.99 out of 5 rating from 149 reviews on Freelancer, with 143 projects completed, 99.5% on time and 99.8% on budget, so you can count on milestone delivery and clear communication. What volume of records per user per month are you planning for, and do you already have a shortlist of target sites or will that be defined together during the first milestone? Let's talk and get started. Thank you.
$250 USD in 10 days
7.4
7.4

TM-HARVEST-31 Hi, I can build the multi-user scraping and lead-generation platform using Django, PostgreSQL, Celery and Redis, with Scrapy/BeautifulSoup and Playwright or Selenium for dynamic sources. I’ll structure it with user-specific data isolation, deduplication, phone/email normalization, Excel/Google Sheets exports, dashboards, admin controls, logging and background scraping jobs. Django officially supports PostgreSQL, and Celery integrates directly with Django while Redis can be used as the task broker. For the first milestone, I’d focus on the core architecture, authentication/user management, database models, scraper framework, one working data source, normalization/deduplication and a basic dashboard, followed by a live walkthrough. I have hands-on experience with Python web scraping, dynamic websites, structured data extraction and high-volume data processing. I can dedicate consistent time to the project and work milestone-by-milestone on your server/private repository. I’d suggest **3–5 days for the first milestone**, with the final fixed price confirmed after reviewing the technical specification and target sources.
$150 USD in 3 days
7.5
7.5

Hello, I am Dr. Rajesh Rolen, PhD in Computer Science & Engineering, with experience of over 20+ years in Web Scraping, Elasticsearch, PostgreSQL, Python, Django, Redis As a preferred freelancer in the top 1%, I have done 400+ projects here on freelancer.com, I have 4.9 ratings out of 5 on average, which showcases my quality of work and timely delivery. Key Highlights: - Free Hosting Support on the Cloud or any desired platform. - Free 3 months of post-delivery support to ensure that our client doesn’t face any challenges after the launch of the project. - Free Dedicated tester on projects to ensure quality delivery, so clients don’t need to act as a tester. - 10+ Years experience UI/UX team to ensure intuitive UI. Portfolio: https://www.freelancer.com/u/Microlent Please open the chat and send me a message, so we can have a more detailed discussion about the project to give you the project timeline and cost. Thank you for considering my services. I look forward to engaging in a productive conversation and understanding how I can be of assistance in bringing your project to life. Regards Rajesh Rolen
$140 USD in 10 days
7.1
7.1

TM-HARVEST-31. Hi there, I understand you’re building a production-grade, multi-user lead generation platform, where scraping is only one part of the system. The critical piece is a reliable data pipeline that can collect from dynamic public sources, normalize and deduplicate records, process jobs asynchronously, and securely deliver clean leads to the correct users. I’m confident I can take ownership of that architecture without turning it into a fragile collection of scrapers. My approach is to first establish the Django/PostgreSQL SaaS architecture, including tenant isolation, user roles, lead schema and admin controls. Then, I’ll build the scraping engine in Python with Celery and Redis, using source-specific extraction, dynamic-page handling, retries, failure logging and controlled concurrency. Next, I’ll implement email/phone normalization, duplicate detection, data validation, Excel/Google Sheets exports and user dashboards. Finally, I’ll deploy everything to your server and rigorously test scraping reliability, concurrent jobs, data quality, permissions and tenant separation before each milestone walkthrough. Which source should be the first production scraping target for Milestone 1, and do you already have its required access/accounts available? Let’s build the core data engine properly so adding new sources becomes controlled and scalable, not a new development problem every time. Warm Regards, Aneesa.
$100 USD in 2 days
7.0
7.0

TM-HARVEST-31. You have arrived at the right place and right skills. I am an experienced developer especially in areas of scraping and crawling with a proven experience in this site and my past work acts as a testimony. I can scrape one sample website for free to gain your confidence if you can share the details
$225 USD in 7 days
6.8
6.8

TM-HARVEST-31 Hello! i can build this with Django, Celery, Redis and PostgreSQL I have strong experience with web scraping, APIs, data cleaning and multi-user platforms for the first milestone i suggest core Django architecture + user system + first scraper + Celery jobs + database I can work on your server and private repo
$1,200 USD in 10 days
6.4
6.4

TM-HARVEST-31 Hello, I went through your project description and understand you need a secure multi-user web scraping and lead generation platform built with Python, Django, Celery, Redis, and PostgreSQL. I will design the platform with a scalable multi-user architecture, separating user data and access while providing dashboards, administration, exports, and reliable background processing. I will build scraping workers capable of handling dynamic public websites, normalize emails and phone numbers, detect duplicates, and prepare clean records for Excel and Google Sheets export. Celery and Redis will manage asynchronous scraping jobs, while PostgreSQL will provide structured and reliable data storage. For the first milestone, I will establish the core architecture, database models, authentication, initial scraping workflow, and Celery/Redis infrastructure, followed by a live walkthrough and validation. I will deploy on your client-owned infrastructure and keep the code in your private repository. Within 24–48 hours after award, I will share a detailed project blueprint and milestone plan. To scope your project clearly, I would like to ask which data sources will be included in the first milestone? Best Regards, Imran `
$90 USD in 1 day
6.2
6.2

TM-HARVEST-31 — I can build this using Python/FastAPI or Django, PostgreSQL, Redis/Celery, with multi-user isolation, deduplication, data cleaning, exports, and admin/user dashboards. My experience includes Python data-processing pipelines, API integrations, PostgreSQL and SaaS backends; I can also implement scraping for public sources, including dynamic pages where permitted. For the first milestone, I’d deliver the core database/user architecture plus one end-to-end source → clean/deduplicate → stored records → export workflow. Fixed Price: $200 | First Milestone: 5–7 days | Availability: 30–35 hrs/week Thanks Anshuman
$140 USD in 7 days
6.4
6.4

TM-HARVEST-31 — Hi, we have experience building Django scraping and lead-generation platforms with Celery, Redis, PostgreSQL, data cleaning, deduplication, dashboards, and Excel/Google Sheets exports. We can build the system with a scalable multi-user architecture and handle dynamic websites using the appropriate scraping tools. 1-Which job portals should we target first? 2-Should you provide the Google Sheets credentials? 3-What timeline do you have for the first milestone?
$140 USD in 7 days
5.8
5.8

TM-HARVEST-31 Hi Sami I will deliver a Django‑Celery platform that scrapes job portals, standardizes phones/emails, removes duplicates and exports to Excel/Google Sheets with user and admin dashboards. I’ll complete the first milestone (core scraper & DB schema) in 5 days for $200. I can start immediately—shall I set up a test scrape for you? Best, Alex Waiting for your response in chat! Best Regards.
$140 USD in 3 days
5.5
5.5

With extensive Python expertise in Django and prior experience in web scraping dynamic sites, I am well-equipped to contribute to your multi-user web scraping and lead generation platform. Could you provide more details on the specific anti-bot handling requirements for this project? TM-HARVEST-31. Regards, Yogesh Kumar
$70 USD in 10 days
5.6
5.6

TM-HARVEST-31 Hi, I can build the Django-based multi-user scraping platform with Celery, Redis, PostgreSQL, deduplication, data cleaning, Excel/Google Sheets export, user dashboard and admin panel. For the first milestone, I suggest setting up the core architecture, user system, database and first scraping pipeline. What public sources should we integrate first, and do you already have the technical specification ready to review? Regards
$220 USD in 2 days
5.7
5.7

I can do it
$140 USD in 7 days
5.4
5.4

TM-HARVEST-31 — I’d begin with the Django tenant boundary and Celery/Redis job pipeline, ensuring each user receives isolated, deduplicated records instead of a shared scrape queue. I’ll use PostgreSQL for normalized leads, source tracking, unique constraints, and safe retry handling for dynamic pages and temporary anti-bot blocks. The first milestone will establish authentication, user isolation, the scraping task flow, phone/email normalization, and duplicate prevention in 3 days. Within 7 days, I’ll deliver the initial working platform with dashboard/admin foundations plus Excel and Google Sheets export, committed to your private repository and deployed on your server. I previously built an outreach system covering Google Maps discovery, contact scraping, personalized email generation, paced SMTP delivery, and unsubscribe handling. Will the first scrape source be a job portal, or another public business source? Muhammad Saad
$250 USD in 7 days
5.0
5.0

Hi, I have built multi-user Python platforms with Django, background job pipelines, and robust data processing. I will implement a secure scraping workflow with Celery tasks for collection and cleaning, enforce duplicate blocking in PostgreSQL, and deliver per-user exports to Excel and Google Sheets via the dashboard and admin panel. I’ve delivered similar lead-generation data systems with reliable job scheduling, queue handling, and clean record outputs. Best, Razmik
$150 USD in 2 days
4.9
4.9

(TM HARVEST 31) The real challenge here is not just scraping data, but building a stable multi-user system that can collect from dynamic sources, normalize records, remove duplicates, and keep each user’s data isolated cleanly. For a platform like this, I’d treat milestone 1 as the foundation phase: project setup, auth/user roles, database schema, queue architecture with Celery/Redis, and one initial scraper pipeline wired into the dashboard flow. I’ve worked on Python-based automation and scraping systems where the difficult part was reliability under changing source structures, not the first scrape itself. Django/PostgreSQL/Celery is a solid stack for this because it gives us a maintainable admin layer, controlled background jobs, and cleaner scaling than trying to glue scripts together. For milestone 1, I can also structure the codebase so future source additions stay modular rather than becoming messy quickly. - Is milestone 1 mainly expected to prove the architecture, or should it already include 1-2 live production scrapers? - Are the initial sources job portals only, or a mix of recruitment and general business directories? - Do you already have preferred hosting/server specs for deployment on your cloud side?
$250 USD in 7 days
5.1
5.1

TM-HARVEST-31 You need a multi-user scraping platform where every user's leads come out clean, deduplicated and exportable, running on your own server. I'd start with one real portal. A Celery task scrapes it into Postgres, phones and emails get normalized, duplicates are blocked on insert, and you get an Excel export to check by hand. It runs on your server from the start, so you see it working where it will live. M1: one portal via Celery into Postgres, phone/email cleaning, dedup, Excel export, $198 M2: more sources, Django admin, per-user dashboard, $200 M3: Google Sheets export, scheduling, handover notes, $202 The $600 is only a number to get me talking, not the price of everything in the brief. It covers M1 and a first slice of M2. The full job gets a real quote once I know how many sources there are and whether any sit behind a login or captcha, since that moves the number most. It holds if the sources are a handful of public job portals, you provide the server and repo access, and the Sheets export uses a service account you create. It also assumes standard Django admin and a simple dashboard with no custom design. If any of that differs, I re-quote before starting. Which portals would you want first, and is any of them behind a login?
$600 USD in 3 days
4.9
4.9

Your scraping architecture will fail under load if you're running synchronous requests without rate limiting and proxy rotation. Public job portals block IPs aggressively, and without a distributed task queue handling retries, you'll lose 40% of your data collection attempts. Quick questions - are you planning IP rotation with residential proxies or relying on request throttling alone? And what's your target data volume per day so I can size the Celery worker pool correctly? Here is the architectural approach: - DJANGO + CELERY: Build async scraping pipelines with exponential backoff, dead-letter queues for failed tasks, and Redis-backed result storage to prevent duplicate processing across users. - POSTGRESQL + ELASTICSEARCH: Design normalized schema for lead deduplication using composite indexes on phone/email, with Elasticsearch for fast full-text search across millions of records without table scans. - ANTI-BOT HANDLING: Implement rotating user agents, session persistence, CAPTCHA solving via 2Captcha API, and Playwright for JavaScript-heavy sites that block requests-based scrapers. I've built 2 SaaS scraping platforms processing 500K+ records daily with zero downtime during peak hours. Let's schedule a 20-minute technical call to review your anti-detection strategy before you commit to infrastructure costs.
$130 USD in 3 days
5.5
5.5

Sittingbourne, United Kingdom
Member since Jul 26, 2026
$30-250 USD
$30-250 USD
$30-250 USD
£20-250 GBP
$30-250 USD
₹750-1250 INR / hour
₹12500-37500 INR
₹12500-37500 INR
€250-300 EUR
₹600-1500 INR
₹100-400 INR / hour
€250-750 EUR
€250-750 EUR
₹12500-37500 INR
₹7500-10000 INR
$10-1000 USD
$2-8 AUD / hour
€12-18 EUR / hour
₹100-400 INR / hour
$30-250 USD
$30-250 USD
₹12500-37500 INR
$250-750 USD
$30-250 USD
$750-1500 USD