Skip to main content
 首页 » 编程设计

python之使用 Python 抓取 HTML 表格

2025年05月04日19qq78292959

我想我真的很接近,所以我们将不胜感激。试图从纳斯达克主页上名为“股票市场事件”的表格中抓取指数和值(value)数据:

def get_index_prices(NASDAQ_URL): 
    html = urlopen(NASDAQ_URL).read()     
    soup = BeautifulSoup(html, "lxml")       
    for row in soup('table', {'class': 'genTable thin'})[0].tbody('tr'): 
        tds = row('td') 
        print "Index: %s, Value: %s" % (tds[0].text, tds[1].text) 
 
 
print get_index_prices('http://www.nasdaq.com/') 

错误读取:

list index out of range

请您参考如下方法:

此表由 javascript 呈现。如果您查看页面源代码,在 javascript 运行之前,您可以看到如下表格:

<div id="HomeIndexTable" class="genTable thin"> 
    <table id="indexTable" class="floatL marginB5px"> 
        <thead> 
        <tr> 
            <th>Index</th> 
            <th>Value</th> 
            <th>Change Net / %</th> 
        </tr> 
        </thead> 
        <script type="text/javascript"> 
            //<![CDATA[ 
 
                nasdaqHomeIndexChart.storeIndexInfo("NASDAQ","5053.75","-20.52","0.40","1,938,573,902","5085.22","5053.75"); 
                nasdaqHomeIndexChart.storeIndexInfo("DJIA","17663.54","-92.26","0.52","","17799.96","17662.87"); 
                nasdaqHomeIndexChart.storeIndexInfo("S&P 500","2079.36","-10.05","0.48","","2094.32","2079.34"); 
                nasdaqHomeIndexChart.storeIndexInfo("NASDAQ-100","4648.83","-21.93","0.47","","4681.23","4648.83"); 
                nasdaqHomeIndexChart.storeIndexInfo("NASDAQ-100 PMI","4675.49","4.73","0.10","","4681.98","4675.49"); 
                nasdaqHomeIndexChart.storeIndexInfo("NASDAQ-100 AHI","4647.33","-1.50","0.03","","4670.76","4647.26"); 
                nasdaqHomeIndexChart.storeIndexInfo("Russell 1000","1153.55","-4.85","0.42","","1161.51","1153.54"); 
                nasdaqHomeIndexChart.storeIndexInfo("Russell 2000","1161.86","-3.76","0.32","","1167.65","1159.66"); 
                nasdaqHomeIndexChart.storeIndexInfo("FTSE All-World ex-US*","271.15","-0.23","0.08","","272.33","271.13"); 
                nasdaqHomeIndexChart.storeIndexInfo("FTSE RAFI 1000*","9045.08","-34.52","0.38","","9109.74","9044.91"); 
            //]]> 
            nasdaqHomeIndexChart.displayIndexes(); 
        </script> 
    </table> 
</div> 

您可以使用 selenium用于抓取。 Selenium 可以执行 javascript。