You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It is possible to retrieve housing sales data from the website, but the following error occurs when attempting to access rental data:
`---------------------------------------------------------------------------
IndexError Traceback (most recent call last)
Cell In[4], line 4
1 from rightmove_webscraper import RightmoveData
3 url = "https://www.rightmove.co.uk/property-to-rent/find.html?searchLocation=W10&useLocationIdentifier=true"
----> 4 rm = RightmoveData(url)
File ~\AppData\Local\Programs\Python\Python313\Lib\site-packages\rightmove_webscraper\scraper.py:220, in RightmoveData._get_results(self, get_floorplans)
217 results = self._get_page(self._first_page, get_floorplans=get_floorplans)
219 # Iterate through all pages scraping results:
--> 220 for p in range(1, self.page_count + 1, 1):
221
222 # Create the URL of the specific results page:
223 p_url = f"{str(self.url)}&index={p * 24}"
225 # Make the request:
File ~\AppData\Local\Programs\Python\Python313\Lib\site-packages\rightmove_webscraper\scraper.py:143, in RightmoveData.page_count(self)
138 @Property
139 def page_count(self):
140 """Returns the number of result pages returned by the search URL. There
141 are 24 results per page. Note that the website limits results to a
142 maximum of 42 accessible pages."""
--> 143 page_count = self.results_count_display // 24
144 if self.results_count_display % 24 > 0:
145 page_count += 1
It is possible to retrieve housing sales data from the website, but the following error occurs when attempting to access rental data:
`---------------------------------------------------------------------------
IndexError Traceback (most recent call last)
Cell In[4], line 4
1 from rightmove_webscraper import RightmoveData
3 url = "https://www.rightmove.co.uk/property-to-rent/find.html?searchLocation=W10&useLocationIdentifier=true"
----> 4 rm = RightmoveData(url)
File ~\AppData\Local\Programs\Python\Python313\Lib\site-packages\rightmove_webscraper\scraper.py:32, in RightmoveData.init(self, url, get_floorplans)
30 self._url = url
31 self._validate_url()
---> 32 self._results = self._get_results(get_floorplans=get_floorplans)
File ~\AppData\Local\Programs\Python\Python313\Lib\site-packages\rightmove_webscraper\scraper.py:220, in RightmoveData._get_results(self, get_floorplans)
217 results = self._get_page(self._first_page, get_floorplans=get_floorplans)
219 # Iterate through all pages scraping results:
--> 220 for p in range(1, self.page_count + 1, 1):
221
222 # Create the URL of the specific results page:
223 p_url = f"{str(self.url)}&index={p * 24}"
225 # Make the request:
File ~\AppData\Local\Programs\Python\Python313\Lib\site-packages\rightmove_webscraper\scraper.py:143, in RightmoveData.page_count(self)
138 @Property
139 def page_count(self):
140 """Returns the number of result pages returned by the search URL. There
141 are 24 results per page. Note that the website limits results to a
142 maximum of 42 accessible pages."""
--> 143 page_count = self.results_count_display // 24
144 if self.results_count_display % 24 > 0:
145 page_count += 1
File ~\AppData\Local\Programs\Python\Python313\Lib\site-packages\rightmove_webscraper\scraper.py:136, in RightmoveData.results_count_display(self)
134 tree = html.fromstring(self._first_page)
135 xpath = """//span[@Class="searchHeader-resultCount"]/text()"""
--> 136 return int(tree.xpath(xpath)[0].replace(",", ""))
IndexError: list index out of range`
The text was updated successfully, but these errors were encountered: