En cours

link Checker

I need a backlinkchecker that looks after a list of backlink.

Available Source Data:

Backlink-URL, Anchor, Link destination, Follow or Nofollow, Checking Interval (Daily, Monthly, Weekly), Backlink ID

Here is want I want to check.

Checking is in 3 Steps.

1. Domain Check

- Checking the domain is alive via DNS and http status code

- Retrieving the IP of the hosting and the land of the IP.

- Retrieve the PR of the domain.

2. Checking the website where the backlink is.

- Look up the robots.txt. Backlink should not blocked via Disallow or Noindex in the robots,txt

- retrieve the webserver header response and checking for a X-Robots tag. Noindex and Nofollow should not be set. Also the http status code should be checked for the website. Must be Http Status Code 200.

- Now some checks on the website HTML. Lookup for Meta Tag Robots, must be Index and Follow. Check for a canonical url and if there is a canonical url it must be the same as the backlink url.

- Get the website Title and save it.

- Get the pagerank of the website

- count all links on the website

3. Checking the Link

- Check the Anchor is the same as in the source data.

- Checking the link destination is the same as in the source data

- checking the rel attribute. must be the same as provided in the sourcce data.

also we want a function that checks the position of the link and the sourrounded text.

I open to suggestions.

All data must be checked inthe intervall (dailiy, monthly, weekly) as provided in the source data.

Every error should be logged and on every check, it must be matched with the last saved data.

Following data should be written in a mysql table like this

Backlink ID, Check Status (True, False), Error (list of errors if check status is false), Domain PR, domain, website PR, all link on the website, IP-adress, last checked date,

I have no favorite programming language for this project, but it should be fast.

I am working on a decision diagramm, that will help to understand the process.

I hope, I have nothing forgotten.

Compétences : Exploitation de Données, Traitement de Données, Web Scraping

Voir plus : web scraping process, table checker, programming robots, programming language list, processing programming language, open source programming language, open dns, look for dns, i get programming language, favorite programming language, fast web scraping, fast web programming language, check website programming language, blocked, canonical, need programming help fast, html checker, html table txt, domain checking, lookup table mysql, html table save, retrieve url, web scraping table data, adress list, html table position

Concernant l'employeur :
( 15 commentaires ) Dortmund, Germany

N° du projet : #1630759

Décerné à :

sayno2bugs

Hi, I have worked on a project which has 75% of the work you have mentioned. Please check my pm to you for more information. -- Nitin

320 € EUR en 5 jours
(13 Commentaires)
6.0

6 freelance ont fait une offre moyenne de 498 € pour ce travail

srinichal

I am an expert in building such tools and look forward to take this up

525 € EUR en 5 jours
(29 Commentaires)
6.1
phpXpertbd

I've done similar projects. Please check PM for more details.

695 € EUR en 12 jours
(18 Commentaires)
5.7
Johir08

I can do this work.

750 € EUR en 30 jours
(7 Commentaires)
4.6
zealotcq

best backlink checker for you

400 € EUR en 7 jours
(1 Commentaire)
1.4
danrain

Yeah, i did like this before . in Python.

300 € EUR en 5 jours
(0 Commentaires)
0.0