I agree that this is a tricky task... even more so than using
a"scraping" package because the page is built dynamically. This will
take someone with skills in multiple web technologies to decipher the web page
scripts to figure out how to manipulate the server to give you the data, because
it isn't actually in the web page.
---------------------------------------------------------------------------
Jeff Newmiller The ..... ..... Go Live...
DCN:<jdnewmil at dcn.davis.ca.us> Basics: ##.#. ##.#. Live
Go...
Live: OO#.. Dead: OO#.. Playing
Research Engineer (Solar/Batteries O.O#. #.O#. with
/Software/Embedded Controllers) .OO#. .OO#. rocks...1k
---------------------------------------------------------------------------
Sent from my phone. Please excuse my brevity.
On August 25, 2015 11:23:26 AM PDT, Bert Gunter <bgunter.4567 at
gmail.com> wrote:>This is not a simple question. The data are in an html-formatted web
>page. You must "scrape" the html for the data and read it into an
R
>table (or other appropriate R data structure). Searching (the web) on
>"scrape data from html into R" listed several packages that claim
to
>enable you to do this "easily". Choose what seems best for you.
>
>You should also install and read the documentation for the XML
>package, which is also used for this purpose, though those you find
>above may be slicker.
>
>Disclaimer: I have no direct experience with this. I'm just pointing
>out what I believe are relevant resources.
>
>Cheers,
>Bert
>Bert Gunter
>
>"Data is not information. Information is not knowledge. And knowledge
>is certainly not wisdom."
> -- Clifford Stoll
>
>
>On Tue, Aug 25, 2015 at 11:10 AM, Christofer Bogaso
><bogaso.christofer at gmail.com> wrote:
>> Hi,
>>
>> I would like to download data from below page directly onto R.
>>
>>
>http://www.nseindia.com/live_market/dynaContent/live_watch/equities_stock_watch.htm
>>
>> Could you please assist me how can I do that programmatically.
>>
>> Thanks for your time.
>>
>> ______________________________________________
>> R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see
>> https://stat.ethz.ch/mailman/listinfo/r-help
>> PLEASE do read the posting guide
>http://www.R-project.org/posting-guide.html
>> and provide commented, minimal, self-contained, reproducible code.
>
>______________________________________________
>R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see
>https://stat.ethz.ch/mailman/listinfo/r-help
>PLEASE do read the posting guide
>http://www.R-project.org/posting-guide.html
>and provide commented, minimal, self-contained, reproducible code.
Actually, in looking again, I noticed a "download in csv" link on the page, and this appears to provide a csv -formatted table that then can trivially be read into R by, e.g. read.csv() . So maybe all the html (or JSON) stuff can be ignored. -- Bert Bert Gunter "Data is not information. Information is not knowledge. And knowledge is certainly not wisdom." -- Clifford Stoll On Tue, Aug 25, 2015 at 11:59 AM, Jeff Newmiller <jdnewmil at dcn.davis.ca.us> wrote:> I agree that this is a tricky task... even more so than using a"scraping" package because the page is built dynamically. This will take someone with skills in multiple web technologies to decipher the web page scripts to figure out how to manipulate the server to give you the data, because it isn't actually in the web page. > --------------------------------------------------------------------------- > Jeff Newmiller The ..... ..... Go Live... > DCN:<jdnewmil at dcn.davis.ca.us> Basics: ##.#. ##.#. Live Go... > Live: OO#.. Dead: OO#.. Playing > Research Engineer (Solar/Batteries O.O#. #.O#. with > /Software/Embedded Controllers) .OO#. .OO#. rocks...1k > --------------------------------------------------------------------------- > Sent from my phone. Please excuse my brevity. > > On August 25, 2015 11:23:26 AM PDT, Bert Gunter <bgunter.4567 at gmail.com> wrote: >>This is not a simple question. The data are in an html-formatted web >>page. You must "scrape" the html for the data and read it into an R >>table (or other appropriate R data structure). Searching (the web) on >>"scrape data from html into R" listed several packages that claim to >>enable you to do this "easily". Choose what seems best for you. >> >>You should also install and read the documentation for the XML >>package, which is also used for this purpose, though those you find >>above may be slicker. >> >>Disclaimer: I have no direct experience with this. I'm just pointing >>out what I believe are relevant resources. >> >>Cheers, >>Bert >>Bert Gunter >> >>"Data is not information. Information is not knowledge. And knowledge >>is certainly not wisdom." >> -- Clifford Stoll >> >> >>On Tue, Aug 25, 2015 at 11:10 AM, Christofer Bogaso >><bogaso.christofer at gmail.com> wrote: >>> Hi, >>> >>> I would like to download data from below page directly onto R. >>> >>> >>http://www.nseindia.com/live_market/dynaContent/live_watch/equities_stock_watch.htm >>> >>> Could you please assist me how can I do that programmatically. >>> >>> Thanks for your time. >>> >>> ______________________________________________ >>> R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see >>> https://stat.ethz.ch/mailman/listinfo/r-help >>> PLEASE do read the posting guide >>http://www.R-project.org/posting-guide.html >>> and provide commented, minimal, self-contained, reproducible code. >> >>______________________________________________ >>R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see >>https://stat.ethz.ch/mailman/listinfo/r-help >>PLEASE do read the posting guide >>http://www.R-project.org/posting-guide.html >>and provide commented, minimal, self-contained, reproducible code. >
... but not programmatically.
---------------------------------------------------------------------------
Jeff Newmiller The ..... ..... Go Live...
DCN:<jdnewmil at dcn.davis.ca.us> Basics: ##.#. ##.#. Live
Go...
Live: OO#.. Dead: OO#.. Playing
Research Engineer (Solar/Batteries O.O#. #.O#. with
/Software/Embedded Controllers) .OO#. .OO#. rocks...1k
---------------------------------------------------------------------------
Sent from my phone. Please excuse my brevity.
On August 25, 2015 12:11:15 PM PDT, Bert Gunter <bgunter.4567 at
gmail.com> wrote:>Actually, in looking again, I noticed a "download in csv" link on
the
>page, and this appears to provide a csv -formatted table that then can
>trivially be read into R by, e.g. read.csv() .
>
>So maybe all the html (or JSON) stuff can be ignored.
>
>
>-- Bert
>Bert Gunter
>
>"Data is not information. Information is not knowledge. And knowledge
>is certainly not wisdom."
> -- Clifford Stoll
>
>
>On Tue, Aug 25, 2015 at 11:59 AM, Jeff Newmiller
><jdnewmil at dcn.davis.ca.us> wrote:
>> I agree that this is a tricky task... even more so than using
>a"scraping" package because the page is built dynamically. This
will
>take someone with skills in multiple web technologies to decipher the
>web page scripts to figure out how to manipulate the server to give you
>the data, because it isn't actually in the web page.
>>
>---------------------------------------------------------------------------
>> Jeff Newmiller The ..... ..... Go
>Live...
>> DCN:<jdnewmil at dcn.davis.ca.us> Basics: ##.#.
##.#. Live
>Go...
>> Live: OO#.. Dead: OO#..
>Playing
>> Research Engineer (Solar/Batteries O.O#. #.O#. with
>> /Software/Embedded Controllers) .OO#. .OO#.
>rocks...1k
>>
>---------------------------------------------------------------------------
>> Sent from my phone. Please excuse my brevity.
>>
>> On August 25, 2015 11:23:26 AM PDT, Bert Gunter
><bgunter.4567 at gmail.com> wrote:
>>>This is not a simple question. The data are in an html-formatted web
>>>page. You must "scrape" the html for the data and read it
into an R
>>>table (or other appropriate R data structure). Searching (the web)
on
>>>"scrape data from html into R" listed several packages
that claim to
>>>enable you to do this "easily". Choose what seems best for
you.
>>>
>>>You should also install and read the documentation for the XML
>>>package, which is also used for this purpose, though those you find
>>>above may be slicker.
>>>
>>>Disclaimer: I have no direct experience with this. I'm just
pointing
>>>out what I believe are relevant resources.
>>>
>>>Cheers,
>>>Bert
>>>Bert Gunter
>>>
>>>"Data is not information. Information is not knowledge. And
knowledge
>>>is certainly not wisdom."
>>> -- Clifford Stoll
>>>
>>>
>>>On Tue, Aug 25, 2015 at 11:10 AM, Christofer Bogaso
>>><bogaso.christofer at gmail.com> wrote:
>>>> Hi,
>>>>
>>>> I would like to download data from below page directly onto R.
>>>>
>>>>
>>>http://www.nseindia.com/live_market/dynaContent/live_watch/equities_stock_watch.htm
>>>>
>>>> Could you please assist me how can I do that programmatically.
>>>>
>>>> Thanks for your time.
>>>>
>>>> ______________________________________________
>>>> R-help at r-project.org mailing list -- To UNSUBSCRIBE and
more, see
>>>> https://stat.ethz.ch/mailman/listinfo/r-help
>>>> PLEASE do read the posting guide
>>>http://www.R-project.org/posting-guide.html
>>>> and provide commented, minimal, self-contained, reproducible
code.
>>>
>>>______________________________________________
>>>R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see
>>>https://stat.ethz.ch/mailman/listinfo/r-help
>>>PLEASE do read the posting guide
>>>http://www.R-project.org/posting-guide.html
>>>and provide commented, minimal, self-contained, reproducible code.
>>