Manually scrape data websiteemplois

I'm looking for an experienced developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping runs seamlessly and accurately in real...

I'm in search of a C developer with strong math ...more streamlined functionality. Key Tasks: * Calculation optimization focusing primarily on code efficiency * Commenting and providing a succinct documentation The project is expected to be wrapped up in two days. The whole source code will be provided by me, and note that there's no Git involved in this project - that is a separate endeavor. Consequently, proficiency in managing source code manually is essential. Electronic mathematics and cpu. Ideal Skills: * Proficient C programming * Comprehensive understanding of electromagnetism calculations * Exceptional skills in writing efficient code * Ability to comment on code and provide useful documentation * Previous experience with manual source code management. Expect...

Need a native Croatian translator who can translate from Croatian to English manually and accuracy. Please bid only native bidders. No agencies or firm. Total: 7 pages (100 words max per page) Budget: Depend on the quality Deadline: Asap

...certain commands via batch file on windows 10/11 computer. (Configurable) - Run local bat comands on Windows computer (configurable) - Send key combinations on Windows computer (configurable) Managing errors if they occurs. Keep CMD open for manually entering other commands ( in feature can be automated as another project or add-on) Prior experience with batch file creation and QNX systems is necessary. Proficiency in SSH connections is also essential for this project. The ideal freelancer would be meticulous and able to effectively organize and back up data....

I'm searching for an expert who can assist me in generating high-quality leads and databases. The candidate should be an expert in scrapping and generating leads, as per the requirement. We are open to buying the lead list and paying for the consultation. Please apply only if you know how to generate and scrape leads in bulk and are an expert or have rich experience in it. We are looking for experts only. Budget is not a constraint for the right candidate. To ensure you have read the description, start your application with the word "Blue" to be considered. Thank you.

I need a professional to scrape names and email addresses from specific public websites. I'm looking to populate a database with details from a range of public websites. This data will be used for lead generation and market research purposes. Ideal skills and experience: - Proficient in web scraping - Familiar with public data extraction - Able to structure data effectively

...keep track of their attendance in the mess. Key Features: - **User Authentication**: The app should ensure that only registered students can use it. - **Notifications**: It should provide notifications to remind students to mark their attendance. - **Mark Attendance**: The core function of the app is to allow students to mark their attendance digitally. Current Data Recording: The attendance data is currently being recorded manually in paper registers. The goal of this application is to digitize this process, making it more efficient and accessible for all the students. Design is already in Figma File Ideal Experience: - Proficiency in Android app development - Prior experience in creating applications

I need someone to gather email addresses from a list of website URLs that I will provide. The goal is to collect email addresses from different sites, which I can then incorporate into my email marketing campaign. Key Requirements: Manually find email address of user from website, by searching in google etc Ideal Skills and Experience: - Proficient web researcher: You should be skilled in navigating websites and efficiently extracting specific pieces of information without getting bogged down. Please make sure to address your experience and expertise in these areas in your proposal. Thank you.

I'm looking for a skilled developer who can create a trading bot that can execute trades on TradingView. The bot should support scalping trading strategies. Key Requirements: - The bot should be able to connect to TradingView and execute trades. - The user should be able to manually enter trade details. Ideal Skills and Experience: - Strong experience in developing trading bots. - Proficiency in working with TradingView API. - Knowledge of scalping trading strategies. Please include any relevant experience you have in developing trading bots, especially those that connect to TradingView. A portfolio or examples of previous work would be highly beneficial.

Need a native Filipino translator who can translate from Filipino to English manually and accuracy. Please bid only native bidders. No agencies or firm. Total: 7 pages (100-150 words max per page) Budget: $2/ each page Deadline: 24 hours

I'm looking for an experienced web developer who can address a few key issues on my WordPress website. - **Theme Fixes**: The primary issue I'm facing is related to theme functionality. This is affecting the overall display of the website. The solution will involve manually uploading the latest version of the theme. - **Core Web Vitals**: I'm also in need of enhancements to improve the loading performance and visual stability of the website. Your expertise in optimizing these aspects will be crucial. - **Blog Page Inspection**: Specifically, I would like you to inspect the navigation menu layout on the blog page. If necessary, you will need to fix any structural issues that may be present. Ideal candidates for this project should have: - Prove...

My Python script is intended to scrape specific Telegram groups, but it's not functioning as expected. I need a developer to address these issues, described below. - **Issue Description**: The script is crashing when scraping certain Telegram groups, which is likely due to the fact that it's not respecting selections. The error presented is “ AttributeError: 'MessageMediaWebPage' object has no attribute 'document'” I can provide the script if you want to check how it’s working. I am open to a whole new script being made. So long as it functions in a similar way. If not familiar you can view telethon api - **Expected Behavior**: The scraping script is supposed to collect data that matches specific regex patterns. This means...

I need a script that can scrape the Google Play store specific data from list of apps in the search result url of any keyword. Need data in Excel spreadsheet. Eg : if i search cat in playstore, i need the below mentioned details of first 100 apps shown in the search result. Key Project Details: - I require the script to scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, da...

I am in need of a versatile developer who can build an integrated messaging system that ties together Facebook Messenger, Slack, and Instagram. The key features of this project include: - Ability to both manually and automatically respond to the received messages. - The automatic response should apply only to text messages. Desired Skills & Experience: - Extensive experience in API integration. - Deep understanding of Facebook Messenger, Instagram and Slack platforms. - Experience in designing systems that handle both automatic and manual responses to messages. - Familiarity with algorithms to effectively auto-reply text messages.

We are seeking a skilled developer or development team to create a comprehensive web crawler system. This system should scrape, structure, and update information from web pages, handle large projects, and be accessible via a powerful API. The system should offer user-friendly features for both individuals and businesses and include flexible user management for both customers and employees. Project Requirements 1. Web Crawling and Data Extraction -Develop a system capable of scraping entire websites and extracting data from each page. -The system should divide the scraped information into sections to facilitate easy reading and understanding. -For e-commerce sites, the system should identify and structure the following information: --Product category (including breadcr...

Hi, I need the following scraped. You can use scraping software or script. YellowPages might be the easiest - law firms and lawyers - only name and email - Colorado, USA

...in need of an e-commerce website that supports Arabic language. Here's what I need: - **Full Website Development**: This includes setting up the website from scratch, making sure all the necessary pages are created, and ensuring it's user-friendly. - **Arabic Language Support**: The website should be developed in a way that fully supports the Arabic language, including all aspects such as product descriptions, user interface, etc. - **Manual Product Management**: I prefer a system where I can manually add and update products. The chosen freelancer should be able to create a simple and efficient system for me to do this. - **Payment Methods**: I'm looking to offer 'Cash on Delivery' as the primary payment method. This should...

I'm looking for a talented freelancer to help me automate a complex process. As of now, I manually gather numerical data from a variety of unstructured sources like images, text, and PDFs. This data includes formulas and is stored both on my local computer and the web. At present, I get ChatGPT to convert this data into a table which I then paste into excel. I do calculations in excel to find out what percent each ingredient is of a total formula. Then I create a new entry into a table in Airtable and paste this data into a different table in Airtable which references the first table. I need someone to automate this data extraction process, calculations and entry into two separate Airtable tables so I can do it repeatedly myself. I work in a s...

I'm looking for an experienced web developer who can address a few key issues on my WordPress website. - **Theme Fixes**: The primary issue I'm facing is related to theme functionality. This is affecting the overall display of the website. The solution will involve manually uploading the latest version of the theme. - **Core Web Vitals**: I'm also in need of enhancements to improve the loading performance and visual stability of the website. Your expertise in optimizing these aspects will be crucial. - **Blog Page Inspection**: Specifically, I would like you to inspect the navigation menu layout on the blog page. If necessary, you will need to fix any structural issues that may be present. Ideal candidates for this project should have: - Prove...

Need a native Croatian translator who can translate from Croatian to English manually and accuracy. Please bid only native bidders. No agencies or firm. Total: 7 pages (100 words max per page) Budget: $2/ each page Deadline: 24 hours

Need a native Portuguese translator who can translate from Portuguese to English manually and accuracy. Please bid only native bidders. No agencies or firm. Total: 7 pages (100-150 words max per page) Budget: $2/ each page Deadline: 24 hours

I'm in need of a skilled professional to help me create a data mining script. The task involves mining emails, data from a certain website and delivering the data in a raw text file format. Key Requirements: - Develop a data miner script that can effectively scrape email data from websites. - Ensure the script can handle multiple sources and is scalable for future needs. - Deliver the mined data in a raw text file format. Ideal Skills: - Proficiency in web scraping and data mining techniques. - Experience with developing scripts for text data mining. - Strong knowledge of scripting languages suitable for scraping like Python/BeautifulSoup, R, etc. Please provide samples of your previous similar projects or port...

I'm in need of a personal website that is both aesthetically pleasing and functional. I'm looking for a classic and traditional visual style that will be appealing to visitors. The main feature of the site will be a live tracking page that provides real-time updates. This tracking page will need to be updated manually at times and also have the ability to automatically update information. Key Requirements: - 6-page personal website - Classic and traditional visual style - Functional, user-friendly layout - Live tracking page with both manual and automatic updating capabilities - Automated email alerts sent at specific intervals - The tracking page should include live updates Ideal Skills: - Proficiency in front-end and back-end web development - Experience ...

1. A portal (website) and Mobile app to accept quotation from customers 2. Customer had to register and must submit following details : a) Mobile Number (Must verify through OTP) b) Email id (Must verify through OTP) c) GST Number (if available ) d) Google map location (if available) after successful registration customer can login and request quotations 3. All the products details like: Product Name, photo, description, features, pdf (data sheet), warranty information, stock (available quantity), sale prices etc. can be uploaded directly through portal and mobile app and also can be uploaded through excel sheet with serial number of all products. 4. Customer can see all the uploaded products and can request for quotation. There is no need to show the available quantity (sto...

I'm looking for someone who can create a WordPress plugin for scraping manga websites. Plugin Requirements...Plugin Requirements: 1. Grab per chapter by link. 2. Grab full chapter by link. 3. Grab new manga by link. 4. Compatible with various manga themes. 5. Images from the scraped content should be uploaded to s3 storage. 6. Must have 10 sources for scraping (with a guarantee that if one source fails or the website goes down, it can switch to another source). Usage Flow: 1. I create a manga post and fill in the manga link in the metabox. 2. The plugin will automatically fill in the chapter links, scrape HTML images, and create posts. It will also automatically fill in the chapter number and the manga post ID number based on the manga link. Note: Speed during scrap...

I need a skilled professional to manually upload 1000 products from our online eBay store to our Magento 2 website. Requirements: - The products will include information such as title number, description, images, sku number, and prices. - You need to ensure that the listings are accurately and completely transferred from eBay to Magento 2. - There's no need to optimize images for web before uploading. Simply uploading as is will suffice. - Please use the existing product descriptions. Ideal Skills and Experience: - Proficiency in using Magento 2, including product management. - Experience in data entry and manual product uploads. - Attention to detail to ensure that all product information is accurately transferred. - Ability to follow instructions carefully an...

I am in need of someone who can help me gather email addresses, websites, and pho...and verifying the company. Any wrong details will need to be collected again unless it is beyond your control (e.g. company has closed down etc.) Automated collection will be erroneous as the data needs to be collected in the following way. use the company names or links from the attached spreadsheet. 2. To copy and paste the company name + UK in the Google search box. The company's operation must be based in the UK as similar names may exist in US as well. 3. Or to click company logo and collect its email addresses, websites, and phone numbe. 4. To manually check the result and collect Website name, Email address and phone number. if there are more than one email address please...

I need a Python developer to create a bot that scrapes data from APIs on an hourly basis. - The bot's primary function is to scrape data - The data will be sourced from APIs - The bot needs to run on an hourly basis Ideal candidate: - Proficient in Python and API data scraping - Familiarity with creating bots - Able to ensure smooth hourly operation, possibly using a scheduling library such as APScheduler

I'm looking for a proficient professional who can effectively scrape leads from LinkedIn, Facebook, and Instagram and all over the internet Key responsibilities: * Extracting Email leads, Phone number leads, and Social media leads. * Collecting specific data - Name, Job title, Company, and Location, email and phone numbers Ideal freelancers for this project should have: * Extensive experience in data scraping, especially on the platforms mentioned above. * Proficiency in data mining techniques and possessing advanced analytical skills. * Understanding of ethical data scraping practices. * Strong attention to detail - ensuring all data is accurate and up-to-date. * Proven track record of delivering quality leads in a short timeframe. Get i...

I'm seeking a professional to help track my personal expenses and investment earnings in a more organized and efficient manner. Key Requirements: - **System Upgrade**: I've been manually tracking these transactions in spreadsheets, but I now need a more robust and automated system. - **Improved Organization**: The primary goal of this project is to enhance my overall financial organization. - **Investment Tracking**: A secondary but important aspect is to have a system in place for monitoring and evaluating my investment performance. Ideal Freelancer: - **Accounting and Bookkeeping Expertise**: Strong background in personal finance and investment bookkeeping is essential. - **Software Proficiency**: Experience in working with personal finance software is highly preferre...

I need a web scraping professional to create a script to extract specific data from , a popular online marketplace for trading cards, please check attachement to get the idea. Key Requirements: - Scrapping: The primary task is to scrape the following information from the platform: - Card properties 1. Hero score for last 7 days 2. Hero rank for last 7 days 3. Stars 4. Rarity 5. Name 6. Quantity listed to purchase 7. Inflation data 8. Minted count - Buy prices List Price Last Price Order book (price and quantity see picture attached) - Bidding details bids book (bid and quantity see picture attached) - Twitter activity per card View Views+ Likes Likes+ Retweets Retweets+ Replies Replies+ Quotes Quotes+ Bookmarks Bookmarks+

...Transaction History Tracking: This feature will allow me to keep track of all my transactions in the crypto market. Additional Pages: - Indicator Tracking: An essential feature that should provide insights into various indicators for informed decision-making. - Project Launch Tracking: I want a dedicated page for tracking upcoming crypto projects that are yet to be launched. I will add the projects manually. - Watchlists: The dashboard should allow me to track Bitcoin, Ethereum, and various Altcoins. (API from CoinStats, CoinMarketCap, or CoinGecko can do that) Bots Monitoring: - The system should be able to monitor the performance of my trading bots and provide me with insights. (I have bots on they offer APIs) -The front-end materials that I will provide you with can be fo...

I'm seeking a Python developer experienced with web scraping. This job involves setting up a Python script that can scrape a popular review site. Key details to extract: - Review text - Star rating - Date of review - Reviewer name - Star-ratings for sub-categories - Review ID - Reviewed person - Reviewed product name The site does not use captchas, so it should be reasonably straightforward. All reviews for a given provider should be scraped. It would be good to have an option to start with the newest and stop at a certain date. The specific review site can be seen in the sample URL in the attached PDF. I can send further details in a private message including screenshots. Preferred frameworks would be Beautifoulsoup 4 / Scrapy if sufficient and Selenium otherwise. Please...

Hi guys, Thanks for your interest in writing for us. IMPORTANT: Human writing only - No AI or Rewriting - (we check) AGAIN BECAUSE THERE ARE SO MANY CHEATERS: NO AI - NO UNDETECTABLE AI AS WE STILL SEE - DON'T WASTE YOUR OR OUR TIME IF YOU DON'T WRITE MANUALLY !!! What we offer: *Writing work at the entry rate of $20/1000 words with room for growth. *Flexibility: No Skyping, no phone calls, accept projects when you have the time to complete them, take time off when you need (letting us know in advance is good practice). *Easy to work with: We reply to questions fast, will provide valuable input and feedback on every single task you complete. *We've been in the content writing and marketing business for 15 years and have worked with more than 2000 clients. ...

I r...scraping professional with experience in extracting text and images from multiple websites. Your task will involve the following: - Scrape data from Sephora, Cult Beauty, Space nk - Extract specifically the Text, Images, Titles, Descriptions, and Prices A strong background in web scraping, data extraction, and working proficiently across different websites is critical for this project. Knowledge in web parsing methods and ability to bypass potential anti-scraping tools or blocks set up on these websites will be highly advantageous. Your goal is to accurately scrape the necessary information without causing disruption to the target websites, and ensure the data is comprehensible and ready for further use. I would like to see an example of 1 pag...

scrape data from darty site and export it into excel file.

I need a Python Selenium application that can scrape blog posts from Site A and post them on Site B. Key Requirements: - The Python app should be built using Selenium for web scraping and automation. - It should be able to extract blog posts from Site A, specifically. - The extracted data must be posted on an existing blog section of Site B. Ideal Skills & Experience: - Proficient in Python, with experience in building web scrapers. - Strong knowledge of Selenium for web automation. - Previous experience with data extraction and manipulation. - Understanding of web protocols and site structures. - Familiarity with blog post formatting and publishing is a plus.

...seeking an experienced developer to create a custom Visual Studio Code extension tailored to my specific requirements. Key Features: - The extension should allow me to define my own set of rules - Specifically, I require the ability to create code formatting rules and code highlighting rules Rule Application: - The code formatting rules must be applicable both automatically upon file save and manually upon command execution. Ideal Skills: - Expertise in creating Visual Studio Code extensions - Proficiency in JavaScript and TypeScript - Prior experience with code formatting and syntax highlighting - Understanding of code linting and analysis - Strong communication skills to understand and implement my unique set of rules. Please provide examples of your previous work in th...

I'm looking to integrate Optical Character Recognition (OCR) into my web application. The primary goal is to automate data entry processes. The current application contains manual data entry. I am attaching a screenshot of how it is entered manually and a picture of the paper from which it is typed. OCR should be done automatically. We can take pictures with a mobile phone in a few seconds so that everything is finished. The application is in spring boot and angular. The database is mysql. Functionality for Taking Photos Using HTML5 and JavaScript, you can use an input element with the type file and the attribute accept="image/*" to allow users to take pictures of documents directly from the browser on a mobile device. Uploading the Image to the Serv...

I'm seeking a skilled freelancer to assist in collecting email addresses for an upcoming email marketing campaign. The ideal candidate will have experience and expertise ...Provide the email addresses in a well-organized manner, making it easy to integrate into our marketing campaign. Target Industries: The primary focus for this collection is media, video production, photo production, TV production, film production, and music production. This means that your understanding of the sectors is crucial for the success of this project. Skills required: - Web scraping - Data collection - Experience with email marketing is a plus - Understanding of media and production industries is preferred Please reach out if you are confident in your ability to deliver high-quality, targeted e...

I am looking for a freelancer who can help me automate my web search for bid opportunities (RFPs) for my telecom company. Currently, I rely on searching manually, but this process is time-consuming and not as efficient as I'd like. Key Project Requirements: - You will be responsible for setting up an automated search that looks for RFPs related to "fiber optic" or other telecom-specific keywords, which are due every May 2024 or similar queries. - This automated search needs to run every 2-3 weeks, ensuring that I stay up-to-date with new bid opportunities and future due dates. - You should have a deep understanding of web scraping and automation to accomplish this task. Additional Information: - I would like to receive notifications about new bid opportunities v...

I'm in need of a skilled professional to help me evolve my business, focusing specifically on sa...professional to help me evolve my business, focusing specifically on sales, marketing, and operations. - **Sales and Marketing**: The goals here are twofold; enhancing the visibility of our brand and improving our lead generation tactics. Experience in digital marketing, social media, and creative marketing strategy is essential. - **Operations and Processes**: Currently, these are handled manually which is time-consuming and inefficient. We're looking for someone to advise us, and possibly implement, a transition to basic or specialized software tools. Ideally, you should have a strong background in operations management and process design. Let's bring our operat...

SIMPLE EASY DATA ENTRY TASK. We will give you a list of domain names to list on a domain site. (about 200 domains) you must go to a whois site Eg: () to get the domain Creation Date to include in the listings. Manually or bulk upload. Easy task that requires strong attention to detail and ability to work accurately Pays $10-$20.

PDF File converted to MS WORD File more than 300 pages Need ASAP

I'm searching for a skilled individual who can help me scrape data from a website. The data I'm interested in is text content and tables, specifically contact information. Ideal Skills: - Proficiency in web scraping tools - Strong experience with scraping text content and tables - Expertise in extracting specific information - Familiarity with structured data formats The contact information on the website is in a structured format. Your ability to navigate this and provide me with a clean, organized dataset will be crucial. Looking forward to collaborating with a detail-oriented and reliable professional. Attached is a sample format. The site is: Final file must contain all records for all schools on all pages

...Authentication (Milestone 1 - Login/Signup): - Users will be able to create accounts (signup) and log in securely. - Authentication will be implemented using Django's built-in authentication system to ensure security and reliability. 2. Geolocation Integration (Milestone 2 - Geolocationization): NO API - The website will integrate geolocation functionality to allow users to find nearby restaurants. - Users can either share their location using their device's geolocation feature or manually input their location. 3. Homepage and Restaurant Listings: - The homepage will display a map interface showing nearby restaurants, bars, and cafes. - Users can click on map markers to view more details about each restaurant, including menus. 4. Restaurant Signup and Management...

...years of experience in agile development of scalable SaaS apps in the cybersecurity area: Improve our app (URL Risk assessment) Improve our app (Domain Typosquatting) Improve our project (Darknet Monitoring) Create an app "hackerview" for passive attack surfave enumeration Create an app for detecting spoofed social media profiles Create an app to scrape ransomware threat actor website and maitain stats about those sites Improve an existing app to monitor paste sites Mininmal Tech Experience: MERN, REST API (JWT), Django, Python, Github, CI/CD, Celery, Redis, Linux, Postgress, Kubernetes, Docker, Nginx, JS, HTML5, Protocols (DNS, SMTP, SSL, HTTP..).Detailed app specifications will be shared at a later stage. |------------------------------------------------

I'm looking to integrate Optical Character Recognition (OCR) into my web application. The primary goal is to automate data entry processes. The current application contains manual data entry. I am attaching a screenshot of how it is entered manually and a picture of the paper from which it is typed. OCR should be done automatically. We can take pictures with a mobile phone in a few seconds so that everything is finished. The application is in spring boot and angular. The database is mysql

I need to change the way my web site updates schedules for tv channels. Right now my site scrapes external sites and pickle dumps and returns data to the site. I want a json or csv to upload to updates all channels manually or we can use my admin to update with file.

I'm looking for a skilled developer to assist with integrating an Inventory API to my WooCommerce plugin. Key Requirements: - Integration of Inventory API: You will be responsible for linking the chosen Inventory API with my WooCommerce platform. This will involve ensuring compatibility and seamless data transfer. - Synchronization: The inventory information should be synchronized both automatically and manually based on my preferences. This includes real-time stock updates and other essential product information. - Usability: The integration should be user-friendly, allowing for easy manual synchronization through a button click. Ideal Skills and Experience: - Proficiency in WooCommerce: You should have a strong background in WooCommerce development, including experie...