Build a list of all Craigslist Cities, Subareas, and Neighborhoods
$30-250 USD
In Bearbeitung
Veröffentlicht vor mehr als 8 Jahren
$30-250 USD
Bezahlt bei Lieferung
We are looking for a database with the full list of / a scraper that can scrape:
- Craigslist "Top Level Cities"
- Craigslist "Sub Areas"
- Craigslist "Neighborhoods"
- All US & CA Cities. Outside of US & Canada is not necessary.
This script should output 4 mySQL tables:
(1) craigslist_city
- schema example: [login to view URL]
- name = look at the name on the market's index, top-middle: [login to view URL]
- alternate name = look at the drop-down box in 'my account', can be linked via code: [login to view URL]
- code = look at the link "post to classifieds" on the market's index
(2) craigslist_city_subarea
- the "city subareas" are a mix of the city and subareas. they have links and codes like cities, but are actually a 1:1 relationship to the subareas in #3 below. you do not need to describe the 1:1 relationship between this table and the subarea table (that is, link them) since there is, as far as I know, no way to automatically link them.
- schema example: [login to view URL]
- pull the codes from here, [login to view URL]
- once you click the code's link you will see the full name just like in [login to view URL]
- if you can link it to craigslist_city that would be GREAT! But I don't see an easy way to link it since the names are SLIGHTLY different and no other common ID exists.
(3) craigslist_subarea
- url will be ?s=subarea, can only be scraped by going to "post to classifieds" as far as I know
- this is more important than #2, these are the 'real' subareas, and once again you will find a 1:1 relationship to #2 above but I cannot find a way to link them and it's not necessary to do so.
- schema example: [login to view URL]
- pull data from [login to view URL] .. (for this example, go to [login to view URL], click post to classifieds, select category and subcategory)
- THIS is the subarea ID that we link the neighborhoods to!
(4) craigslist_hood
- url will be ?s=hood, can only be scraped by going to "post to classifieds" as far as I know
- if you click "san francisco" subarea as in the example in #3, you'll come to a page like this: [login to view URL]
- schema example: [login to view URL] -- the city_id refers to #1 above and the subarea_id refers to #3 above [NOT 2!]
That's it. I have a PDF ready that explains all of the above but in more in depth language if necessary.
Let's discuss more and finalize the project and proposal. We have our own workplace with 7+ working PCs and laptops, with ~15mbps internet connections. And we never out re-source our projects that we have taken from our clients :-)
Feel free to ask me questions, if any. I look forward to work with you.
You can also contact me through Skype. Have a good day and stay fine :-)
Sincere regards,
Jubair
eSolutions
i have read your all details i can create a scprit and extract all listings of CL sites into SQL table
can u send me SQL table format you want to get?
i have read your all details i can create a scprit and extract all listings of CL sites into SQL table
can u send me SQL table format you want to get?
Hi,
I have read your project discripiton and I am confident that I can make your project done. I think I have the skills you are looking for. I have very good skills on UI/UX Designing, HTML, CSS, Jquery,wordpress, PHP and etc. I can make your project done with full efficiency as I am a professional Web Designer/ Developer.
With 3+ year of working experience I have always offer my best quality work.
I am new on freelancer but I have positive attitude toward work.
money is not matter for me I just need long term business relationship and good review from you.
hope to hear from you.
thanks,
Aditya.