Comments on: Extracting Content From Websites Using BeautifulSoup http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/ Programming, Writing, and The Internet Sun, 05 Feb 2012 02:43:00 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: joshaidan http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/comment-page-1/#comment-25891 joshaidan Thu, 14 Apr 2011 15:39:00 +0000 http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/#comment-25891 yeah, too much ruby programming. :) yeah, too much ruby programming. :)

]]> By: Bsdwiz http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/comment-page-1/#comment-25890 Bsdwiz Thu, 14 Apr 2011 15:17:00 +0000 http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/#comment-25890 array? i think you mean list. array? i think you mean list.

]]> By: Steven Pigeon http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/comment-page-1/#comment-25543 Steven Pigeon Wed, 22 Oct 2008 19:45:06 +0000 http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/#comment-25543 I'm also learning to use BeautifulSoup for that kind of manipulation, and I have to suggest a (small) improvement for your code: not all <a rel="nofollow"> have a href (as I discovered the hard way). Use<br><br>url=a.get('href') ( that may return None)<br><br>or <br><br>url = a.get('href', '' ) if you don't want None.</a> I'm also learning to use BeautifulSoup for that kind of manipulation, and I have to suggest a (small) improvement for your code: not all have a href (as I discovered the hard way). Use

url=a.get('href') ( that may return None)

or

url = a.get('href', '' ) if you don't want None.

]]> By: Steven Pigeon http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/comment-page-1/#comment-25172 Steven Pigeon Wed, 22 Oct 2008 15:45:06 +0000 http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/#comment-25172 I'm also learning to use BeautifulSoup for that kind of manipulation, and I have to suggest a (small) improvement for your code: not all <a> have a href (as I discovered the hard way). Use<br><br>url=a.get('href') ( that may return None)<br><br>or <br><br>url = a.get('href', '' ) if you don't want None.</a> I'm also learning to use BeautifulSoup for that kind of manipulation, and I have to suggest a (small) improvement for your code: not all have a href (as I discovered the hard way). Use

url=a.get('href') ( that may return None)

or

url = a.get('href', '' ) if you don't want None.

]]> By: Recent Links Tagged With "beautifulsoup" - JabberTags http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/comment-page-1/#comment-25157 Recent Links Tagged With "beautifulsoup" - JabberTags Fri, 26 Sep 2008 19:49:43 +0000 http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/#comment-25157 [...] public links >> beautifulsoup Extracting Content From Websites Using BeautifulSoup Saved by secroxs761 on Wed 24-9-2008 [Yaoi Manga] Sore wa Yappari ai Kamone - by Riyu Yamakami [...] [...] public links >> beautifulsoup Extracting Content From Websites Using BeautifulSoup Saved by secroxs761 on Wed 24-9-2008 [Yaoi Manga] Sore wa Yappari ai Kamone – by Riyu Yamakami [...]

]]> By: Brian http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/comment-page-1/#comment-25127 Brian Tue, 15 Apr 2008 14:06:09 +0000 http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/#comment-25127 Tawa, You're not going to want to start at the command line. Start with a programming language such as Python or Ruby. First you will need to build a script to extract content from the website. http://www.python.org http://www.ruby-lang.org Brian. Tawa,

You’re not going to want to start at the command line. Start with a programming language such as Python or Ruby. First you will need to build a script to extract content from the website.

http://www.python.org
http://www.ruby-lang.org

Brian.

]]> By: Brian http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/comment-page-1/#comment-25861 Brian Tue, 15 Apr 2008 14:06:00 +0000 http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/#comment-25861 Tawa, You're not going to want to start at the command line. Start with a programming language such as Python or Ruby. First you will need to build a script to extract content from the website. http://www.python.org http://www.ruby-lang.org Brian. Tawa,

You’re not going to want to start at the command line. Start with a programming language such as Python or Ruby. First you will need to build a script to extract content from the website.

http://www.python.org
http://www.ruby-lang.org

Brian.

]]> By: tawa http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/comment-page-1/#comment-25126 tawa Tue, 15 Apr 2008 11:28:19 +0000 http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/#comment-25126 This is good. Certainly looks like what I am looking for. However, I am very new to this. In order to implement the above, say I want to parse a website, what should I place at the commandline? I short, I need to know how to start. thanks This is good. Certainly looks like what I am looking for. However, I am very new to this. In order to implement the above, say I want to parse a website, what should I place at the commandline? I short, I need to know how to start. thanks

]]> By: tawa http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/comment-page-1/#comment-25862 tawa Tue, 15 Apr 2008 11:28:00 +0000 http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/#comment-25862 This is good. Certainly looks like what I am looking for. However, I am very new to this. In order to implement the above, say I want to parse a website, what should I place at the commandline? I short, I need to know how to start. thanks This is good. Certainly looks like what I am looking for. However, I am very new to this. In order to implement the above, say I want to parse a website, what should I place at the commandline? I short, I need to know how to start. thanks

]]> By: 繁星满天» Blog Archive » links for 2008-03-22 http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/comment-page-1/#comment-25091 繁星满天» Blog Archive » links for 2008-03-22 Sat, 22 Mar 2008 05:41:09 +0000 http://www.brianjones.ca/archives/2008/01/27/extracting-content-from-websites-using-beautifulsoup/#comment-25091 [...] Extracting Content From Websites Using BeautifulSoup (tags: Python) [...] [...] Extracting Content From Websites Using BeautifulSoup (tags: Python) [...]

]]>