Website Scraping Project - 15/05/2018 06:15 EDT

We need to scrape course information from two Australian university websites. Generally course information is the same for Australian and International students, however if there is any difference then scrape the international information only. The information we need to acquire is : name - text (255) - The name of the course , code - text (255) - The code the university uses for the course url - text (any) - The URL of this course on the university website overview - text - Overview information about the course outline - text - This List of mandatory and elective subjects in the course, may also include specialisation paths. prerequisite_text - text - What you are required to know to enter this course eg. IELTS 6.0, faculty - text (255) - Which faculty or school does this course belong to ?eg. School of Law, Faculty of Engineering institution - text (255) - Which institution this course belongs to e.g. Latrobe or Deakin duration - text (255) - What are the study options e.g. 2 years or 2 years full-time. units - text(255) - Some institutions will assign units to courses e.g. 64 or 237 unit_type - text(255) - Some institutions use units from a national scheme - If this is relevant place this information here - for our test this is probably empty. cost_currency - text(255) - The local currency - This is always AUD cost_amount - text (255) - How much this course costs international students to study cost_unit - text (255) - Are the costs per year, per unit or per semester ? eg. year or term delivery - text (255) - How is this course delivered ? e.g. Online or On Campus or Both delivery_locations - text(255) - Which campuses deliver this course ? (comma separated list) level - text (255) - What qualification does this course provide ? e.g. Bachelor, Graduate Diploma, Masters meta - text - Any meta data associated with this course e.g. Cricos Code, QTAC course code. This should be in the format cricos:233ER76, qtac:7865332 summary - text - paragraph that summarises the course (first paragraph of overview or whole overview if overview is only one paragraph). Information should be provided in CSV or JSON format. Thanks, Cheers Richard