python - Extracting text from chart in Beautiful soup -


relatively new beautifulsoup , i'm trying extract data webpage: http://reports.workforce.test.ohio.gov/program-county-wia-reports.aspx?name=gtl8gammduly5gslycy7wq==&datatype=hip9ibmbiwbkor1wvt5bkg==&datatypetext=hip9ibmbiwbkor1wvt5bkg==#

i grab numbers under headings "program completers", "employed second quarter", etc. relevant part of html code is:

<ul class="listbox">                <li class="li1">   <p style="cursor:help" class="listtop" title="wia adult    completers individuals have exited wia adult program    individual received core staff-assisted service (such job    search or placement assistance) or intensive service (such   counseling, career planning, or job training). individuals    participated in wia through self-service, ohiomeansjobs.com, or other    less intensive programs not included in dashboard.">program    completers</p>   <p id="programcompleters1">18</p></li>

i want string "program completers" , "18". have tried implementing these solutions here, here, , here without luck. 1 version of code is:

from bs4 import beautifulsoup import urllib2  url="http://reports.workforce.test.ohio.gov/program-county-wia-reports.aspx?name=gtl8gammduly5gslycy7wq==&datatype=hip9ibmbiwbkor1wvt5bkg==&datatypetext=hip9ibmbiwbkor1wvt5bkg==" hdr = {'user-agent': 'mozilla/5.0 (windows nt 6.1; wow64) applewebkit/537.36 (khtml, gecko) chrome/37.0.2062.120 safari/537.36',        'accept':'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8'}  req = urllib2.request(url, headers=hdr) page = urllib2.urlopen(req)  soup = beautifulsoup(page) tag in soup.find_all('ul'):     print tag.text, tag.next_sibling

this returns text other parts of webpage tagged 'ul'. have been unsuccessful in grabbing text inside chart area. how can retrieve text want?

thank help!

as mentioned before data you're looking in iframe, access @chosen_codex says here:

http://reports.workforce.test.ohio.gov/wiareports/wia_county.aspx?level=county&datatype=hip9ibmbiwbkor1wvt5bkg==&name=gtl8gammduly5gslycy7wq==&programdate=kf/2jvcffrgqjjodwv7l08atxxm/adw9p1fwfz9j7o8=

you can access fields interested by:

data = {} tag in soup.find_all('p'):     if tag.get('id'):         data[tag.get('id')] = tag.text  print(data)  >> print(data.get('programcompleters1')) 18

-

Comments

Post a Comment

Popular posts from this blog

css - SVG using textPath a symbol not rendering in Firefox -

using textpath within symbol doesn't render in firefox. renders fine in latest chrome , ie, when try reference symbol, svg text doesn't render in firefox (37.0.1) - first box appears empty. code below (no external dependencies), there should 2 boxes word test flowing vertically in centre of each. edit: thought issue somehow involved flexbox layout, until paul pointed out issue exists without flexbox layout. the html is: <div> <svg id="not_working" viewbox="0 0 250 1200" preserveaspectratio="xmidymid meet"> <symbol id="test_symbol1" preserveaspectratio="xmidymid meet" viewbox="0 0 250 1200"> <path id="test_symbol_path" d="m 100 1200 l 100 0" /> <text font-size="100" fill="red"> <textpath text-anchor="middle" startoffset="50%" xlink:href="#test_symbol_path...
Read more

Java 8 + Maven Javadoc plugin: Error fetching URL -

i attempting generate javadoc links javadoc dependencies. have tried various means generate javadoc not produce qualified class names references classes dependencies. wanted links java doc simplified class names. however, java api classnames, no links , have qualified class names. working java 8. have following configuration: <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-javadoc-plugin</artifactid> <version>2.10.2</version> <configuration> <reportoutputdirectory>${project.basedir}/target</reportoutputdirectory> <destdir>javadoc</destdir> <windowtitle>epiphany</windowtitle> <doctitle>epiphany</doctitle> <show>private</show> <detectlinks>false</detectlinks> <detectoffline...
Read more

datatable - Matlab struct computations -

i download data yahoo! finance with: data = getyahoodailydata({'msft', 'axp'},'01/01/2000', '01/01/2015', 'dd/mm/yyyy'); and data stored 1x1 struct. want create tx2 matrix of daily adjusted closing prices msft , axp, column 7 in each table in struct. how can that? or better : there way make computations directly on information/prices in struct? you can access data in struct name. vecmsftadj = data.msft.adjclose; vecaxpadj = data.axp.adjclose; % if want n x 2 matrix madjclose = [vecmsftadj, vecaxpadj]; % personnaly prefer working table tadjclose = table; tadjclose.msftadj = vecmsftadj; tadjclose.axpadj = vecaxpadj;
Read more