Web Scrap Medical Website

État: Closed
Prix: $110
Propositions reçues: 3
Gagnant: Verz1Lka

Winner

Résumé du concours

I need to scrap a website that contains professional information.

The final product is a .csv (or excel) file with all information along with the python script that you used to scrap the website.

The website is in portguese (brazilian)

url: http://portal.cfm.org.br/index.php?option=com_medicos&Itemid=59

You will find a form to search for healthcare professionals.

First line: leave it blank

Second line: The first box should be left blank. The second box is a list of states (loop through all states).

Third line: List of cities. Once you have selected a State, it will show the list of all cities of that state. (loop through all cities)

Fourth line: choose 'ativo'

Fifth line: choose 'todos'

Sixth line: (CIRURGIA DO APARELHO DIGESTIVO) and (CIRURGIA GERAL)

The database should contain all information for every name:

State (UF)
City (município)
Specialty (especialidade)
Name (Nome do Médico)
Situation (situação)
CRM
Tipo de inscrição
Especialidade/Area de atuação (1)
RQE (1)
Especialidade/Area de atuação (2)
RQE (2)
Especialidade/Area de atuação (n)
RQE (n)

p.s.: 'Todos' means 'All'

The website breaks the results in pages, please be aware of that.

I have attached an example of the result I need

Compétences recommandées

Winner

Publiez un concours comme celui-ci

Commentaire de l'employeur

“Great job! Other people took days to scrap the website, while he took only hours.”

victorarakawa, Brazil.

Tableau de clarification publique

knowledgeexcavat
- il y a 9 ans
wow... just attached 3 files and it is closed :(
- il y a 9 ans
1. knowledgeexcavat
  - il y a 9 ans
  and there are 18499 entries...
  - il y a 9 ans
knowledgeexcavat
- il y a 9 ans
What about AREA_ATUACAO_3 RQE_3 ? Some persons have 3.
- il y a 9 ans
1. Titulaire du concours
  - il y a 9 ans
  Yes, you should create AREA_ATUACAO_n for n=1,2,3...
  - il y a 9 ans
hwanghendra
- il y a 9 ans
Hi are you open to using other language, eg php ?
- il y a 9 ans
thenamescarlos
- il y a 9 ans
Is there a known issue or specific reason with having "Todos" being the option selected for the box in the second line?
- il y a 9 ans
1. Titulaire du concours
  - il y a 9 ans
  Because I want all options. You can do it by each option, but I dont need that.
  - il y a 9 ans
clackkensmith
- il y a 9 ans
Hi !
i am a scraper, bellow is project of my last customer :
demo file : https://mega.co.nz/#!91YXDTzJ!hQOtqZzptKMJhcfKJSu5q120intcp9_0qgUD-xNLpoM or attach file
Link get : http://www.gassaferegister.co.uk/registersearch/checkbusiness.aspx
You can check by accountNumber at that page and check information.
Bid me or message with me for detail about job.
thank you !
- il y a 9 ans
knowledgeexcavat
- il y a 9 ans
Could you #increaseprize if work be done in 1 day?
- il y a 9 ans
talhamunir2002
- il y a 9 ans
hi cane we made script in c#
- il y a 9 ans
Voir 1 message de plus
1. talhamunir2002
  - il y a 9 ans
  okz....i can provide you data if needed and script in c#,if needed,ping me
  - il y a 9 ans
2. MEDIAPRONET
  - il y a 9 ans
  scrape price:20$ per 1000 records,also,if you want a bot,i can make it for 200$(without code)
  - il y a 9 ans
TECHRONYX
- il y a 9 ans
# sealed plz
- il y a 9 ans
braedon213
- il y a 9 ans
is the search working right now? it was working for me earlier but now anytime i search i get "Não existe nenhum resultado para essa busca"...
- il y a 9 ans
1. Titulaire du concours
  - il y a 9 ans
  Maybe you are trying a combination that has no results to show. E.g., there is no professional in the city with that specialty.
  - il y a 9 ans
braedon213
- il y a 9 ans
i don't see "CIRURGIA DO SISTEMA DIGESTIVO" under Especialidade.
- il y a 9 ans
1. Titulaire du concours
  - il y a 9 ans
  OK, I have just fixed that, you are right
  - il y a 9 ans
2. Titulaire du concours
  - il y a 9 ans
  CIRURGIA DO APARELHO DIGESTIVO is the right option
  - il y a 9 ans
braedon213
- il y a 9 ans
I see "CIRURGIA DO APARELHO DIGESTIVO" and "CIRURGIA GERAL" however. Is SISTEMA the same as APARELHO?
- il y a 9 ans