Weekly Daft.ie MyHome Scraper

@farhanyoussef18

Youssef, Full-Time Python Developer, expert in data extraction and automation. Your goal is a tidy, searchable archive of property listings from Daft and MyHome, complete with photos and metadata, even after ads vanish. I will build a dependable, scheduled scraper using Scrapy for efficient crawling, with Playwright to handle any JavaScript-rendered content, ensuring full data capture. Anti-scraping measures like rate limiting, rotating user agents, and proxy rotation will keep the script reliable. I have completed numerous similar web scraping and automation projects. To confirm the setup, would you prefer the initial backfill to be organized by property ID or by date? Ready to start immediately.

@rajat07me

Your brief is well laid out, and yes, this can be automated properly so you have an offline archive even after listings disappear. I’d prefer a Python-based scraper with clean folder-based storage for each property, plus a metadata file containing the price, description, and source details. I would also build in duplicate checks, weekly scheduling, and simple run logs for transparency. Happy to handle both the initial setup and the ongoing weekly management.

@asifdwan

Hi, I can build and maintain a reliable automated scraper to archive property listings from your approved sources. Using Python with Scrapy/Playwright or Selenium where needed, I'll create a weekly scheduled solution that captures new or updated listings, downloads images, stores prices and descriptions, and prevents duplicates using listing IDs or URLs. The project will include logging, an initial backfill of current listings, and well-organized CSV/Excel/JSON output with offline image folders. I'll also implement respectful rate limiting, retries, and configurable request handling for reliable long-term operation.

@w3saddam

Hello, I'm interested in your project and have experience building Python web scrapers using Scrapy, Selenium, and BeautifulSoup. I can create an automated weekly scraper with de-duplication, image downloads, metadata storage, logging, and an initial backfill of current listings. The scraper will use responsible rate limiting, rotating user agents, and request throttling for reliable operation. I can deliver the first working version within 5–7 days and provide ongoing monthly maintenance if needed. I look forward to working with you.

@hiberokpars

Hi! I have extensive experience building reliable web scrapers and long-running automation systems. I can develop a Node.js + Playwright solution that runs weekly, avoids duplicates, downloads all images, stores metadata, and keeps detailed logs. The scraper will be easy to maintain, and I can also provide ongoing monthly support if needed.

@shivansh121

Hi, Message me here.I am available here to start the work. Looking forward to an early and positive response. Regards, Shalu

@Web1devloper

As a seasoned data analyst and scientist, I've spent the last decade unlocking insights hidden within complex datasets for a myriad of businesses across finance, healthcare, e-commerce, and SaaS - skills which I believe perfectly match your project needs. With my expertise in powerhouse technologies such as **Python**, **Scrapy/Selenium/BeautifulSoup**, and other segregating databases like **SQL**, I'm confident I can not only deliver the scraper you need but also implement scalable measures like rate limiting and header rotation to bypass potential anti-scraping hurdles. I understand your need for an organized and de-duped archive. That's why I will leverage my proficiency in data storage techniques such as JSON, CSV, or Excel to create an easily navigable archive while ensuring its airtight search functionality. My experience with **ETL & Data Engineering** (using tools like Apache Airflow, Talend/Alteryx, AWS Glue /Google Cloud Dataflow) enhanced the quality of each task executed and added value to my clients' projects which is what I intend to replicate here. Lastly, I respect time just as much as you do. Therefore, rest assured that I possess the efficiency and execution skills necessary to promptly deliver results. My approach focuses on providing consistent value while constructing a long-term partnership born of trust that you desire on this project. Let's initiate cautious scraping sans compromise on data fidelity!

@denisSolution

Hi, The main challenge is building a reliable scraper that runs weekly without manual oversight while capturing listings exactly as they appear online. I’ve done similar work before, most recently for a real estate pipeline where we preserved listing details and images for months. The same approach works here—a Python scraper that runs weekly, checks for new/updated properties using IDs to avoid duplicates, and stores each listing in a clean folder structure with metadata and image downloads. Storage is simple: a dated folder per run with JSON for data and a subfolder for images, keeping things searchable without complexity. The tricky part is scraping—both sites have anti-bot measures, so we’ll rotate user agents, throttle requests, and use proxies if needed. Selenium may be safer for initial loads since both sites rely heavily on JavaScript, but Scrapy with middleware tweaks could work if we handle dynamic content properly. First, I’d test a small batch to confirm selectors, then scale up and schedule weekly runs via cron or GitHub Actions. A key risk is sites changing HTML structure unexpectedly—those breaks can go unnoticed. I’ll add a check that fails gracefully and alerts you if the scrape completes but data is missing, so we can fix it fast. Image downloads can also fail, so we’ll include retries and logging. If you’re okay with it, I can share a quick prototype of the folder structure and metadata format before finalizing the setup. Thanks, Denis

@FreelancerTechX

Hello, I fully understand your requirements. I am ready to start Best Regards, Everest Technology .

@toriquldev123

Hello There! I’m Md Toriqul Islam, and I’m excited to partner with you. I can dive into your project immediately. I have rich experience in Python, web scraping, Selenium, Scrapy, BeautifulSoup, and automation. I am skilled in Python, scheduled scraping, data extraction, CSV/Excel/JSON export, image downloading, and deduplication logic. I understand you need an automated weekly scraper to archive new and updated property listings, including prices, descriptions, photos, and metadata, with reliable scheduling, searchable storage, and duplicate prevention. I can build a robust, well-documented solution with logging and an initial back-fill. My expertise in Python, Selenium, Scrapy, automation, and data processing ensures reliable, maintainable results. I’m ready to start immediately and would be happy to discuss your project. Feel free to ask any questions. Looking forward to hearing from you. Best regards, Md Toriqul Islam

@krupnovdenis

Hello! We can build and run a reliable weekly property archiving solution for this task. 1. Do you want the initial backfill to include only live listings? 2. Are there any anti-scraping limits or access constraints we should account for? — About us We are dZENcode – a full-cycle IT company for digital product development: from design and programming to integrations and post-release support. We build projects from scratch and also work on existing solutions that need further development, improvements, or technical support. You can find detailed information about our services and rates on our official website: https://dzencode.com. Please review it – after that, we can discuss the details and agree on the next step. ⚠️ After clarifying all details, we will define the scope, the suitable cooperation format – task-based, outsourcing, or outstaffing – and the final cost. Projects are guaranteed to reach release with us: • 10+ years providing IT services; • 90+ in-house specialists; • 250+ public reviews since 2015; • We support products under SLA after launch; • We work under NDA and a company contract!

@ffulb

The hard bit here is keeping both sites scrapable long-term without triggering rate limits or getting your server IP banned outright—Daft and MyHome both sit behind Cloudflare and will 403 you fast if the scraper looks automated. I'd build this with Python + Playwright in stealth mode for the initial fetch, then cache HTML locally and parse with BeautifulSoup offline so repeat runs stay fast. Residential proxy rotation through Bright Data keeps the IP clean, and I'll add jitter between requests plus realistic scroll behavior so the traffic pattern looks human. Storage goes into dated folders—one per listing ID, images downloaded with original filenames, metadata as JSON. Deduping checks the listing ID hash against a SQLite index before saving anything new. The whole thing runs on systemd timer, logs to a simple text file with timestamp and record count, and if Cloudflare throws a challenge mid-run the script pauses and emails you rather than burning through proxies. Day one I'd verify both sites still serve full descriptions without login, confirm the listing ID format hasn't changed since last year, then write the parser for one property end-to

@marjanahmed13

Hi! My name is Marjan and I'm here to offer you my services as a skilled applicant with over a decade of experience working on Freelancer.com. l believe I am the best fit candidate for this project due to my extensive experience; I would like to have a discussion to get to know that we both are on the same page. Once the scope will be locked, I will start working on it right away.

@rosscarter1011

hello, The clever part of your brief is the de-duping, because it doubles as change tracking. You want new or updated listings, so keying on listing ID lets the scraper not just skip duplicates but notice when a price drops or a description changes on a listing it already has, which is exactly the kind of thing worth capturing in a property archive. Building that comparison in from the start turns a plain scraper into a genuine record of how each ad evolved. For the stack I would lean on Python, using a browser-based approach where the sites load content dynamically, since property portals often render prices and galleries through JavaScript that a plain request misses. Each listing gets its own folder, images downloaded for true offline access, with a metadata file holding the exact price and wording, so months later it opens just as you asked. On anti-scraping, a weekly run is gentle by nature, so sensible rate limiting, rotating headers, and human-like pacing keep it dependable without hammering either site. Do you want the full photo set per listing, which gets storage-heavy over time, or a capped number each? And should the archive log price and description changes when a listing updates, or just keep the latest version? have a nice day.

@dataspro

Nice to meet you ,The requirements of your project match my areas of work and skills, to introduce myself. My name is Anthony Muñoz and i am the lead engineer for DS Pro IT agency. I have worked for over 10 years as a Full-Stack and software development engineer and have successfully done multiple jobs. It will be a pleasure to work together to make your project. Feel free to discuss about the project with me, greetings.

@emilesd617

Hi, I am a python developer with 8 years of rich experience in software development, with a background in . I am familiar with Python, Web Scraping, Scrapy, Selenium, BeautifulSoup, Automation, Data Processing, Software Architecture, Data Management, etc. For this project, I will build a reliable weekly scraper with deduplication, automated scheduling, structured data storage, image archiving, logging, and anti scraping measures such as rate limiting and rotating request headers. I'm an individual freelancer and can work on any time zone you want. Please contact me with the best time for you to have a quick chat. Looking forward to discussing more details. Thanks. Emile.

@amgadmourad18

Hello , I"m a professional web scraper . i can deliver your scraper within a week . i will use selenium and beautiful soup for scraping and celery for queue jobs . i will use proxies rotation , rate limiting for anti scraping precautions . waiting for your response soon thanks.

@huzaifa306

Hi, I can build a reliable automated scraper that archives property listings, images, and metadata with scheduled weekly runs, de duplication, and organized storage. I have experience building Python automation and web scraping solutions with scheduled workflows, anti scraping techniques, and structured data storage. Best regards

@AndrewJSMAN

I’ve built and deployed Scrapy-based scrapers for Irish property portals before, so this is straightforward. I’ll use Scrapy + Splash for JS-heavy pages, Python 3.11, and SQLite for storage with a WAL journal for concurrency. Anti-measures: 3s delays between requests, rotating user-agents via `fake-useragent`, proxies from residential pool, and randomized jitter to mimic browser behavior. The pipeline will store metadata in JSON, images in `{id}/photos/`, and enforce de-dupe via URL hashing. First working run, including back-fill, takes 3–4 days; weekly cron runs via systemd timer with log rotation. Thanks, Andrii.