r - GET {httr} returns a Bad Request response -

-

i trying scrape html elements of url stored insearchlink. method worked me ishtmltreeparse {xml}.however it's not returning elements i'm looking for. example:img[@title='add compare'] 

searchlink <- "http://www.realtor.ca/map.aspx#cultureid=1&applicationid=1&recordsperpage=9&maximumresults=9&propertytypeid=300&transactiontypeid=2&sortorder=a&sortby=1&longitudemin=-114.52066040039104&longitudemax=-113.60536193847697&latitudemin=50.94776904194829&latitudemax=51.14246522072541&pricemin=0&pricemax=0&bedrange=0-0&bathrange=0-0&parkingspacerange=0-0&viewstate=m&longitude=-114.063011169434&latitude=51.0452194213867&zoomlevel=11&currentpage=1"   doc <- htmltreeparse(searchlink,useinternalnodes = t)      classes <- xpathsapply(doc,"//img[@title='add compare']",function(x){xmlgetattr(x,'class')})

the result of running classes above:

list()

i have tried readlines , get {httr} both returned error in reading url. guessing it's because of special characters in url don't know how go fixing it. response given below:

response [http://www.realtor.ca/map.aspx#cultureid=1&applicationid=1&recordsperpage=9&maximumresults=9&propertytypeid=300&transactiontypeid=2&sortorder=a&sortby=1&longitudemin=-114.52066040039104&longitudemax=-113.60536193847697&latitudemin=50.94776904194829&latitudemax=51.14246522072541&pricemin=0&pricemax=0&bedrange=0-0&bathrange=0-0&parkingspacerange=0-0&viewstate=m&longitude=-114.063011169434&latitude=51.0452194213867&zoomlevel=11&currentpage=1]   date: 2014-12-01 16:46   status: 400   content-type: text/html; charset=us-ascii   size: 324 b <!doctype html public "-//w3c//dtd html 4.01//en""http://www.w3.org/tr/html4/strict.dtd"> <html><head><title>bad request</title> <meta http-equiv="content-type" content="text/html; charset=us-ascii"></head> <body><h2>bad request - invalid url</h2> <hr><p>http error 400. request url invalid.</p> </body></html>

try removing 1 # in url, replaced ?

library("httr") url <- "http://www.realtor.ca/map.aspx?cultureid=1&applicationid=1&recordsperpage=9&maximumresults=9&propertytypeid=300&transactiontypeid=2&sortorder=a&sortby=1&longitudemin=-114.52066040039104&longitudemax=-113.60536193847697&latitudemin=50.94776904194829&latitudemax=51.14246522072541&pricemin=0&pricemax=0&bedrange=0-0&bathrange=0-0&parkingspacerange=0-0&viewstate=m&longitude=-114.063011169434&latitude=51.0452194213867&zoomlevel=11&currentpage=1" res <- get(url) tt <- content(res)

then parse html content in tt


Comments

Post a Comment

Popular posts from this blog

c++ - OpenMP unpredictable overhead -

-
i have simple openmp code runs 4 empty threads , reports time: #include "omp.h" #include <sys/time.h> #include <cstdio> double start_time; void process_thread() { } int main(){ struct timeval tv; gettimeofday(&tv, null); start_time = 1000*((double)tv.tv_sec + 1e-6*(double)tv.tv_usec); printf("beginning time: %.3fms ",start_time-start_time); #pragma omp parallel schedule(static,1) for(int i=0;i<4;i++) process_thread(); gettimeofday(&tv, null); double cur_time = 1000*((double)tv.tv_sec + 1e-6*(double)tv.tv_usec); printf("finishing time: %.3fms\n\n",cur_time-start_time); } without openmp running time small , consistent: beginning time: 0.000ms finishing time: 0.050ms beginning time: 0.000ms finishing time: 0.050ms beginning time: 0.000ms finishing time: 0.049ms beginning time: 0.000ms finishing time: 0.049ms beginning time: 0.000ms finishing time: 0.050ms beginnin...
Read more

ruby on rails - RuntimeError: Circular dependency detected while autoloading constant - ActiveAdmin.register Role -

-
i using activeadmin , have file doing this: activeadmin.register role something--- end however, server gives me error: runtimeerror: circular dependency detected while autoloading constant role /library/ruby/gems/2.0.0/gems/activesupport-4.0.10/lib/active_support/dependencies.rb:461:in `load_missing_constant' /library/ruby/gems/2.0.0/gems/activesupport-4.0.10/lib/active_support/dependencies.rb:184:in `const_missing' ~/desktop/boxfox/app/admin/role.rb:1:in `<top (required)>' /library/ruby/gems/2.0.0/gems/activesupport-4.0.10/lib/active_support/dependencies.rb:424:in `load' /library/ruby/gems/2.0.0/gems/activesupport-4.0.10/lib/active_support/dependencies.rb:424:in `block in load_file' /library/ruby/gems/2.0.0/gems/activesupport-4.0.10/lib/active_support/dependencies.rb:616:in `new_constants_in' /library/ruby/gems/2.0.0/gems/activesupport-4.0.10/lib/active_support/dependencies.rb:423:in `load_file' /library/ruby/gems/2.0.0/gems/activesuppor...
Read more

javascript - Wordpress slider, not displayed 100% width -

-
so im making first wordpress theme scratch going fine got problem. want slider on homepage 1 thing wrong. im setting width of image 100% !important doesnt go 100% width. makes image wider not 100%. example here: http://bit.ly/11ouebg see image doesnt contain whole width. can see background-color. really weird, im using meteor slides. i hope can me out :d
Read more