Extracting links with specific class using css selectors
I have the following HTML structure
I want to extract all the links with the class:dev-link
<a class="dev-link" href="mailto:info@jourist.com" rel="nofollow" title='Photoshoot"</a>
I am using the below code to extract the link in scrapy
response.css('.dev-link::attr(href)').extract()
I am getting the correct output but is this the right way to use css selectors??
As you can see in Scrapy Documentation there are two methods to scrap data, CSS Selector and XPath Selector both are works correctly but XPath needs some practice to get expert, in my opinion, Xpath is more power in special cases you can scrap data easier that CSS selector ( but of course you can get them with CSS selector too),
what you did is correct
link = response.css('.dev-link::attr(href)').extract_first()
and also you can get it with the following too
link = response.xpath('/[contains(@class,’dev-link’)]/@href').extract_first()
-
05:30
-
04:00
-
00:00
-
10:30
-
9:10
-
07:40
Firebase Cloud Functions: PubSub, "res.on is not a function"
-
04:00
TypeError: Cannot read properties of undefined (reading 'createMessageComponentCollector')
-
9:20
-
7:40
- typescript: tsc is not recognized as an internal or external command, operable program or batch file 111365 visits
- search for elements in a list 111045 visits
- In Chrome 55, prevent showing Download button for HTML 5 video 98806 visits
- RxJS5 - error - TypeError: You provided an invalid object where a stream was expected 96304 visits
- Ionic 2 - how to make ion-button with icon and text on two lines? 92496 visits
- NetBeans IDE - ClassNotFoundException: net.ucanaccess.jdbc.UcanaccessDriver 62018 visits
- Adding methods to es6 child class 22362 visits
