Ruby on Rails Sunday, June 18, 2017

I'm extracting content from some websites. Currently I evaluate HTML code using Nokogiri. But the relevant content is not contained in the responded body of the HTTP GET request. This is because there is some Javascript code like $(window).load() or $(document).ready() that will send some Ajax requests and fill the original HTML code.

So I'm searching for some library that automatically executes Javascript code and Ajax requests just like a normal browser.

Martin

Von meinem Samsung Gerät gesendet.


-------- Ursprüngliche Nachricht --------
Von: Colin Law <clanlaw@gmail.com>
Datum: 18.06.17 09:42 (GMT+01:00)
An: "Ruby on Rails: Talk" <rubyonrails-talk@googlegroups.com>
Betreff: Re: [Rails] browser simulator independent of web framework

On 17 June 2017 at 22:58, Martin L. <martin.luy@gmx.net> wrote:
> Hi all,
>
> Is there any browser simulator that fulfills these requirements:
>
> - gem written in Ruby
> - automatically performing Ajax and Javascript code (XSS is not an issue in
> my case)
> - independent of the frameworks used by the website (Rails, JavaEE, ASP.NET,
> ...)
> - only client-side
> - no testing
> - no browser dependency

What do you mean 'no testing'? If not for testing then what is it for?

Colin

--
You received this message because you are subscribed to a topic in the Google Groups "Ruby on Rails: Talk" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/rubyonrails-talk/H_YImOIzNNo/unsubscribe.
To unsubscribe from this group and all its topics, send an email to rubyonrails-talk+unsubscribe@googlegroups.com.
To post to this group, send email to rubyonrails-talk@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/rubyonrails-talk/CAL%3D0gLvqHArcWpbZ5gsfCiPg0EF%3D4kD8QzZbC3KnicN58uAZ8A%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

No comments:

Post a Comment