This Job is to scrape course data from college websites put the data of each college into an excel document. This job should be completed within a day.
College 1- Emory
1) Go to: [login to view URL]
2) Select "African American Studies"
3) Click the link to: 000: Intro To Afric Amer Studies
4) For each of the courses, collect the "Course Title", "Course Number", and "Credits" for all the courses in the subject and put it in an excel file.
As an example, the first course in the art subject would be:
Course Title: Intro To Afric Amer Studies
Course Topic: Introduction to African American Studies
Course Number: AAS 100-000
Credits: 4
5) Repeat these steps for every course and every department.
6) Delete any repetitive courses.
College 2 - University of Pittsburgh
1) Go to: [login to view URL]
2) Only for the Fall 2010 Semester, go through each department in the School of Arts and Sciences, College of Business Administration, College of General Studies, Honors College and other programs, and collect the following data on each of the courses: the "Subject", "Catalog Number", "Title" and "Credits/Units".
As an example,
Title: Introduction To Afrcna Studies
Subject: AFRCNA
Catalog Number: 0031
Credits: 3
3) Repeat these steps for every course and every department.
4) Delete any repetitive courses.
College 3 - Binghamton University
1) Go to: [login to view URL]
2) Select Fall 2010 and click submit
3) In the subject field, select: "AAAS - Asian Asian Am Study" and for all the other fields leave the default selection "All" and then click "Class Search". You will see a listing of courses. The first course listed should be "East Asian Civilizations (LEC) - 10020 - AAAS 106A - A 0"
4) As an example for all the other courses, for "East Asian Civilizations" you should collect the following data and put them in seperate columns on the excel sheet:
Course Title: East Asian Civilizations
Course Code: AAAS 106A
Course Credits: 4.000
Course Type: LEC
Associated Term: Fall 2010
Levels: Undergraduate
5) Repeat this for all the courses in the database. (There are about 9552 courses in the entire database.)
College 4- Boston U
1) Go to: [login to view URL]
2) In the semester dropdown, Select Fall 2010. In the the class subject dropdown select "any", and click the go button that is on the right hand side of the subject field.
3) For each class listed from this search, collect "Title", "Cr Hrs", and "Course". To find the "course" for a class, click the link in the "class column" and you will see the "Course" and "Title".
4) At the bottom of the page, there will be a button that says "continue subject listing". Click that button, and continue scraping the classes until there are no more classes are displayed.
College 5- BYU
1) Go to: [login to view URL]
2) Select ACC Accounting
3) You will see a list of courses displayed.
4) For each class listed from this search, collect "Course Title", "Credits", and "Course Title".
5)As an example, the first two courses listed are:
Course Code: ACC 200
Course Title: Principles of Accounting
Course Credits: 3.0
Course Code: ACC 241
Course Title: Business Law
Course Credits: 3.0
6) Repeat these steps for all "Courses" in all "Teaching Areas"
Budget : 80 USD