
Completed
Posted
Paid on delivery
We have a working but partially complete Python platform that scrapes, consolidates and normalises real-estate listings from several Angolan sources into a single database. We need an experienced developer to improve and optimise it — not build from scratch. The full technical specification is attached. What already works 6 sources: AngoCasa (5,000+ listings), AngoImóveis, MIA (Supabase API), Zenki, REE Gera, and RE/MAX (Azure Cognitive Search API — partial; basis to be confirmed). SQLite database, deduplication, resumable checkpoints, price-change history, Excel export. What we need — the focus of this job (improvements) RE/MAX parser: fix extraction of headline, typology, bedrooms, bathrooms (WC), area and description (the API often returns internal references that must be reconstructed). AngoCasa: reliably extract phone, WhatsApp, advertiser/agency and main image URL. Performance: replace sequential detail-fetching with parallel execution (ThreadPoolExecutor or async) + per-domain rate limiting. Target: 60–80% faster. The goal is to extract all listings from each source (the --max-anuncios flag is only for testing). Excel: monetary format 8 500 000,00, Yes/No for booleans, and interactive Excel dashboards/filters (analytics are delivered inside Excel). Normalisation: currencies AKZ / USD / EUR (BNA reference rate, stored per conversion), typologies (T0/T1/V4) and a neighbourhood (bairro) dictionary. Later milestones (optional) New public sources: Facebook Marketplace (search-term based), then Facebook groups and Instagram. Propose a stable, lawful collection approach. SQLite → PostgreSQL migration; opportunity score; monthly executive report. Hard requirements Source isolation — if one source fails, the others must keep running. Maintainable, modular, documented code (one module per source) + README, [login to view URL], config file, logs, basic tests and selector-maintenance notes. How to bid — please include Examples/links of resilient scrapers and API integrations you've built (Azure Cognitive Search / Supabase a plus). Your approach to parallelisation and to handling sites that change frequently. A realistic timeline and milestone breakdown.
Project ID: 40499112
92 proposals
Remote project
Active 5 days ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

Hello, I carefully reviewed your requirements and this is exactly the type of project I enjoy working on. Since the platform is already operational, I would focus on improving reliability, extraction accuracy, and performance without disrupting the existing architecture. I can fix the RE/MAX parser reconstruction logic, enhance AngoCasa data extraction, implement parallel processing with controlled rate limiting, improve normalization rules, and deliver Excel exports with advanced dashboards and analytics. I follow a modular scraper architecture with source isolation, comprehensive logging, tests, and documentation, ensuring future maintenance remains straightforward. I can also prepare the codebase for a future PostgreSQL migration and additional data sources. I’d be happy to discuss the attached specification and start immediately. Looking forward to working with you.
$60 USD in 5 days
0.0
0.0
92 freelancers are bidding on average $214 USD for this job

Hello there, I am experienced in web scraping and building scripts or a Windows desktop application using Python. I am also experienced in large data scraping from a given website, bypassing IP, Captcha, and anti-bot or cloud flair protection. Please message me to discuss this project in detail. Best Regards Enamul
$100 USD in 2 days
8.3
8.3

⭐⭐⭐⭐⭐ Improve and Optimize Your Python Real-Estate Scraping Platform ❇️ Hi My Friend, I hope you are doing well. I've reviewed your project details and see you're looking for an experienced developer to enhance your Python platform for real-estate listings. You don’t need to look any further; Zohaib is here to help you! My team has successfully completed over 50 projects similar to yours. I will optimize your existing platform by fixing parsers, improving performance, and ensuring the code is maintainable and efficient. ➡️ Why Me? I can easily improve your Python scraping platform as I have 5 years of experience in web scraping and API integration. My expertise includes data extraction, performance optimization, and database management. I also have a strong grip on modular coding practices, ensuring that your platform remains efficient and maintainable. ➡️ Let's have a quick chat to discuss your project in detail and I can show you examples of my previous work. I look forward to discussing this with you in chat. ➡️ Skills & Experience: ✅ Python Development ✅ Web Scraping ✅ API Integration ✅ Data Normalization ✅ Performance Optimization ✅ SQLite & PostgreSQL ✅ Excel Automation ✅ Threading & Async Programming ✅ Code Documentation ✅ Error Handling ✅ Modular Code Design ✅ Data Analysis Waiting for your response! Best Regards, Zohaib
$150 USD in 2 days
8.0
8.0

Hi, We’ve built resilient web scrapers that adapt to changing HTML structures and handle frequent site updates. For example, we developed a fully automated product scraper for Amazon that used multiple techniques to extract product data, including image URLs, reviews, and A+ content. We also implemented a CI/CD pipeline to ensure that the scraper was always up-to-date and functional. In your case, we can use a similar approach to create a dedicated module for each source, allowing us to isolate failures and ensure that one broken source doesn’t affect others. We can also implement a CI/CD pipeline to run tests on a schedule, so we can proactively fix any issues before they impact production. Let’s schedule a quick 10-minute call to discuss your project in more detail and see if I’m the right fit for your needs. Feel free to message me anytime—I usually respond within 10 minutes. I’m eager to learn more about your exciting project. Best regards, Adil
$124.30 USD in 7 days
6.0
6.0

As an accomplished Full-Stack Developer with a proven track record of delivering complex web applications, AI systems, and trading bots on-time and to the client's satisfaction, I'm confident I have the right skillset and mindset for your project. Throughout my career, I've consistently prioritized one core value: adaptability. The unique nature of your project aligns perfectly with my expertise in creating resilient scrapers and API integrations. Parallelization is essential for your project's efficiency and maintaining compatibility with sites that change frequently is a key concern. My approach involves using frameworks like ThreadPoolExecutor or async to ensure multiple requests are handled simultaneously while enforcing rate limits specific to each domain. This strategy has routinely delivered remarkable enhancements in performance - exactly what you're aiming for, a 60-80% speed boost. In the end, maintaining a clean codebase is as important as hitting performance targets in any substantial project. My commitment to clean, modular, documented code pairs well with your demand for source isolation and maintainability. It'd be my pleasure to work on this endeavor and bring all these attributes together to improve and optimize your existing Python platform into a robust real estate web scraper. Let's discuss the details further so we can establish realistic timelines and milestones that fit your needs.
$140 USD in 3 days
5.8
5.8

Hi, I can optimize your existing Angolan real estate scraper by refactoring the code for parallel execution using Python's asyncio or ThreadPoolExecutor to achieve the 60-80% speed target while maintaining per-domain rate limits. I will fix the RE/MAX Azure Cognitive Search parser to reconstruct internal references and enhance the AngoCasa scraper to reliably extract contact details and images. Additionally, I will implement robust currency normalization (AKZ/USD/EUR) with BNA rates, improve the Excel export with proper formatting and interactive dashboards, and ensure source isolation so failures in one module do not stop the others. You will receive optimized, modular source code with comprehensive documentation, updated requirements, and a clear README. I have extensive experience building resilient, high-performance web scrapers and API integrations, including work with Azure and Supabase, ensuring clean data and maintainable architecture. I also offer FREE post-delivery support to monitor initial scraping performance, troubleshoot any selector changes on target sites, and assist with minor adjustments during the first month. Let's discuss the project in more details.
$250 USD in 7 days
5.9
5.9

I'll optimize your existing Python scraper by fixing the RE/MAX Azure Cognitive Search parser for headline/typology/beds/baths/area/desc reconstruction, reliable AngoCasa phone/WhatsApp/agency/image extraction, and swap sequential fetches for ThreadPoolExecutor/async with per-domain rate limiting to hit 60-80% faster while keeping source isolation. I'll also implement Excel monetary format 8 500 000,00, Yes/No booleans, interactive dashboards/filters, AKZ/USD/EUR normalization with BNA rates, typology + bairro dictionaries, plus modular docs, tests, logs, and README so one source failing never breaks the others.
$140 USD in 2 days
5.7
5.7

This looks straightforward at first, but in my experience there’s usually a key detail that can cause issues later. I’ve handled similar projects before and can outline a practical approach for you. For similar work and case studies, feel free to check my profile: https://www.freelancer.com/u/Microlent Let me know if you I'd like me to walk you through the plan. – Rajesh Rolen
$140 USD in 7 days
6.2
6.2

Hello, For the RE/MAX parser fix, do you have specific error logs or outputs? Is there a preferred format for the Excel dashboards? Excited about optimizing this platform! I’ll ensure the platform runs smoothly by improving parallel execution for speed. One challenge is maintaining performance with changing sites; I’ll handle this with regular updates. I’ll gladly provide examples in chat. Let's discuss the timeline and costs after reviewing specifics together. Looking forward to a chat to fine-tune details and take this project forward. Just drop a message, and we can start!
$30 USD in 1 day
5.1
5.1

Hello, I can help optimize and extend your existing real-estate scraping platform rather than rebuilding it. My focus would be on fixing the RE/MAX and AngoCasa extractors, improving data quality, and significantly increasing performance through parallelized scraping with controlled per-domain rate limiting while preserving source isolation and resumable execution. Experience includes Python scraping frameworks, API integrations, SQLite/PostgreSQL pipelines, data normalization, and large-scale data extraction systems. I can also enhance the Excel exports with proper formatting, filters, and dashboard-style analytics. I would start with a code review of the current platform, then deliver improvements in clear milestones with documented, maintainable modules and testing. Looking forward to reviewing the attached files and discussing the implementation details. Best regards
$73 USD in 3 days
5.3
5.3

With my extensive background in electrical engineering, software development, and data science, I am the ideal candidate to optimize your Python-based real estate web scraper. I recently completed a similar project where I built a scraper that collected and consolidated relevant data for a large-scale government project. This experience has given me a fine understanding of handling sites that change frequently and the ability to deliver resilient scrapers and API integrations. In line with your project's hard requirements, I've garnered a reputation for developing maintainable, modular, and thoroughly documented code throughout my career. My approach incorporates one module per source, which promotes easy maintenance going forward. In addition to my technical skills, my deep knowledge of Excel will be invaluable in implementing the monetary format required as well as creating interactive Excel dashboards/filters for seamless data analytics. To ensure maximum efficiency, I propose implementing parallelization using either ThreadPoolExecutor or an async approach alongside per-domain rate limiting. This strategy has proven to increase performance by 60–80% on past projects. With this as a backbone for improvement, we can work towards the goal of extracting all listings from each source while targeting the desired time frames. Let's join forces to optimize your web scraper and achieve unprecedented efficiency in consolidating Angolan real estate listings!
$250 USD in 7 days
5.2
5.2

Hi, I've thoroughly reviewed your project to optimize the existing Python-based real-estate web scraper focused on Angolan listings. With extensive experience in resilient web scraping, API integrations including Azure Cognitive Search and Supabase, and a strong background in parallel execution and rate limiting, I am confident in enhancing your current platform without starting from scratch. I will precisely fix the RE/MAX parser to accurately extract all required fields, improve the AngoCasa parser for reliable contact and image extraction, and implement ThreadPoolExecutor or async-based multi-threading for a performance boost of 60-80%. I will also ensure currency normalization with dynamic BNA rates, enrich Excel exports with proper monetary formats, booleans, and interactive dashboards, and maintain source isolation for fault tolerance. I propose an initial 10-day timeline focusing on the core improvements, followed by optional milestones if needed. My approach will ensure modular, well-documented code with logging and basic tests, prioritizing maintainability. Could you please share the specific challenges you've faced with the RE/MAX parser or any peculiarities in the API responses that we should prioritize? Thanks,
$155 USD in 10 days
4.2
4.2

Your project is exactly the type of work I specialize in. I have 9+ years of experience in Python web scraping, data extraction, web crawling, and scraper optimization, and I've worked extensively on both building new scrapers and enhancing existing scraping systems that were already in production. I've completed multiple scraping projects involving Selenium, Playwright, API integrations, dynamic websites, anti-bot challenges, data normalization, and large-scale crawling workflows. I've also worked with crawler frameworks and custom extraction pipelines for maintaining data quality across multiple sources. For your platform, my focus would be on improving and stabilizing the existing system rather than rebuilding it. The RE/MAX parser improvements, AngoCasa extraction fixes, performance optimization through parallel processing, normalization enhancements, and Excel reporting requirements are all well within my area of expertise. I also understand the importance of source isolation, maintainable modules, checkpoint recovery, logging, testing, and long-term scraper resilience when source websites change. I've worked with API-based sources, browser automation, structured data extraction, and large-volume data processing pipelines, making me comfortable with the Azure Cognitive Search and Supabase aspects of your stack as well. Cheers!
$250 USD in 7 days
4.3
4.3

Hi, I’m interested in helping optimize and extend your existing real-estate aggregation platform. My expertise is in Python, large-scale web scraping, API integrations, data normalization, and performance optimization, making this a strong fit. For the immediate scope, I can: • Fix the RE/MAX parser to reliably reconstruct headline, typology, bedrooms, bathrooms, area, and description from Azure Cognitive Search responses • Enhance AngoCasa extraction for phone numbers, WhatsApp, agency/advertiser details, and primary image URLs • Implement parallel processing (ThreadPoolExecutor or async workflows) with per-domain rate limiting to significantly reduce execution time while maintaining stability • Improve normalization for currencies (AKZ/USD/EUR), typologies, and bairro mapping • Upgrade Excel exports with proper monetary formatting, Yes/No fields, filters, and dashboard-ready analytics My approach emphasizes source isolation, modular architecture, logging, retry mechanisms, checkpoint recovery, and selector maintenance so individual source failures never affect the overall pipeline. Experience includes: • High-volume web scraping and data aggregation systems • REST APIs, Azure-based APIs, and Supabase integrations • Distributed scraping, rate limiting, and anti-breakage strategies • SQLite/PostgreSQL data pipelines and reporting automation
$140 USD in 7 days
4.1
4.1

Hi there! I am available for your task and do your task with full responsibility. Could we discuss more details over chat? Thank You
$30 USD in 1 day
3.9
3.9

I can optimize your existing scraper platform, fix RE/MAX/AngoCasa extraction issues, implement parallel processing for major speed improvements, and deliver a stable, maintainable solution with enhanced Excel reporting.
$100 USD in 2 days
3.9
3.9

With my robust skill set in system analysis, coding and data visualization, optimizing your Python-based real estate web scraper will be a breeze. Over the last decade, I have developed several resilient scrapers and worked extensively with API integration tools such as Azure Cognitive Search and Supabase, which are specifically mentioned in your project description. My particular expertise in Python (FastAPI) makes me uniquely positioned to solve the RE/MAX parser issues you're encountering. Parallelization is another area where I thrive; utilizing the latest technologies like ThreadPoolExecutor or async, I've consistently delivered systems that are 60-80% faster. Completing this project within a realistic timeline and milestone breakdown won't be an issue for me. I understand the value of maintaining a modular, documented codebase given your hard requirements of source isolation and maintainability, and this is built into my development philosophy. Overall, my expansive experience in handling mutable environmental factors, coupled with my solid understanding of the real estate industry's needs from my LMS work, position me perfectly to optimize your system, effectively extracting all listings from each source at an impressive speed without hampering reliability or maintainability. Choose me for a result-oriented partnership and together we'll build a highly performant tool that revolutionizes Angolan real estate data consolidation. Let's bring your vision to life!
$100 USD in 7 days
3.8
3.8

Welcome to professional Python development services! Hi there, I'm Alema, a Python expert programmer who strives for clear code in atmospheric, numerical weather prediction, physics, and all other seminal fields. I'm ready to provide you with high-quality services. I have completed 350+ projects with a 100% Positive Rating. If you are looking for Quality work, look no further. Tech stack: Python, FastAPI, Django PostgreSQL, SQLAlchemy React, JavaScript, TypeScript Docker, Docker Compose CI/CD (GitHub Actions, GitLab CI) AWS (EC2, S3, Lambda, ECS), DigitalOcean, Heroku NGINX, Caddy If you're looking for a reliable Python backend developer to help with your project, feel free to reach out. Your faithfully. Eng. Alema Akter
$100 USD in 1 day
3.5
3.5

Lets chat, a free consultation and no obligation. I understand you need a clean, professional, and user-friendly solution for your "Optimize Python-Based Real-Estate Web Scraper" project. My skills in PHP, Java, JavaScript are a perfect fit for this project. While I am new to freelancer.com, my extensive experience delivers integrated, automated solutions. Regards, Jason McLachlan
$188 USD in 3 days
3.3
3.3

Dear Sir/Madam, I have a professional team experienced in Python, web scraping, API integrations, data processing, and database optimization. We understand your requirements and can improve your existing platform, including RE/MAX and AngoCasa extraction fixes, parallel processing for faster scraping, data normalization, Excel reporting enhancements, and overall performance optimization. Let’s connect in the chatbox to discuss the project further, including the budget and timeline. I am ready to work with you, please connect in the chatbox for further discussions. Thank You. Dr. Divya.
$140 USD in 7 days
3.6
3.6

With my diverse and specialized coding experience, I am confident in my ability to optimize your Python-based real-estate web scraper and take it to new heights. Scraper optimization is a role I'm well-acquainted with, having previously improved parallel executions and rate limiting. You can expect a solid 60-80% jump in performance from me - an invaluable asset for a project driven by data consolidation. I've built resilient scrapers and API integrations in the past and integrated Azure Cognitive Search and Supabase which aligns with your project's inclinations. My approach to source isolation ensures that even if one source might fail, the others keep running seamlessly. In terms of adaptability, I excel in handling sites that change frequently. I promise well-constructed, modular and documented code that is easier for you or anyone in your team to work on in the future. Additionally, my approach involves regular updates keeping you informed about the progress at every stage. Engage me for maximum reliability, expedited solutions, and impactful results that'll help take your scraper to the next level!
$140 USD in 7 days
3.0
3.0

Luanda, Angola
Payment method verified
Member since May 14, 2021
$750-1500 USD
$10-30 USD
$30-250 USD
$30-250 USD
$250-750 USD
₹1500-12500 INR
$10-30 USD
₹1500-12500 INR
₹12500-37500 INR
₹12500-37500 INR
₹1500-12500 INR
$5-50 USD / hour
₹600-1500 INR
$100-200 USD
₹750-1250 INR / hour
$30-250 USD
$250-750 USD
₹12500-37500 INR
£20-250 GBP
$250-750 USD
$250-750 USD
₹600-1500 INR
₹100-400 INR / hour
₹1500-12500 INR
$30-250 USD