Ruby on Rails Wednesday, November 7, 2018



On Sunday, July 29, 2018 at 4:14:03 AM UTC-4, Colin Law wrote:
On 29 July 2018 at 03:43, fugee ohu <fuge...@gmail.com> wrote:


On Saturday, July 28, 2018 at 10:43:37 AM UTC-4, Colin Law wrote:
On 28 July 2018 at 15:32, fugee ohu <fuge...@gmail.com> wrote:


On Saturday, July 28, 2018 at 2:53:59 AM UTC-4, Colin Law wrote:
On 28 July 2018 at 00:15, fugee ohu <fuge...@gmail.com> wrote:
how do i webscrape aliexpress? i learned how to get a document object class Nokogiri::HTML containing the full html but there's no tables only ul and li selectors and i'm having trouble with that

Give us an example of a page you are scraping and an element you can't find.

Colin


Thanks Colin Made progress so now I have the <ul> list i want in an object I named ul Not sure how I'm gonna proceed My goal is to import to database tables  It's a few related tables instead of just one products table I don't think you still wanna see all that html do you?

If you are now seeing the data then no I don't want to see it.  Your original problem is fixed.

Colin


I could read the item description on the page in the browser but couldn't find it searching the source I'm new to using the browser debugging console I never had any reason to use it before So I couldn't find the description I saw on the page in the source so I right clicked on the description and selected inspect This is what I got: 
<li class="property-item" id="product-prop-19204" data-attr="272" data-title="Wireless" data-spm-anchor-id="2114.12010108.0.i4.7c48412aEPVyt2">
                        <span class="propery-title">Cord Length (m):</span>
                        <span class="propery-des" title="Wireless">Wireless</span>
                    </li>
What can I do with this?

If you can see the description in the browser but not in the source then as a web developer I am sure you can think of at least a couple of ways that might happen.

Colin


Even if so, wouldn't the javascript leave the html visible in the source? 

--
You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rubyonrails-talk+unsubscribe@googlegroups.com.
To post to this group, send email to rubyonrails-talk@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/rubyonrails-talk/becd3904-e3cd-46e2-9161-4d2f57766829%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

No comments:

Post a Comment