NAME

WWW::Scraper::Yahoo360 - Yahoo 360 blogs old-fashioned crappy scraper

SYNOPSIS

  use WWW::Scraper::Yahoo360;

  my $y360 = WWW::Scraper::Yahoo360->new({
      username => 'myusername',
      password => 'mypassword',
  });

  # Debug what's happening?
  $WWW::Scraper::Yahoo360::DEBUG = 1;

  # First you have to login
  $y360->login() or die "Login failed?";

  # High level blog information
  my $blog_info = $y360->blog_info();

  # Gets all the blog posts
  my $posts     = $y360->get_blog_posts();

  # Gets all the blog post comments
  my $comments  = $y360->get_blog_comments();

DESCRIPTION

Ignorant web scraper, based on WWW::Mechanize, that connects to your Yahoo 360 account and tries to fetch the blog posts and comments you still have on their service.

If it breaks, well... it's a scraper.

This module is used on the My Opera Community, http://my.opera.com, to import Yahoo 360 existing blogs into My Opera blog service.

SUBROUTINES

`new(\%args)`

Where \%args is a hashref with username and password of your Yahoo 360 account.

This creates a new WWW::Scraper::Yahoo360 object, ready to scrape.

Fetches high-level blog information for your Yahoo 360 blog. If a $blog_page argument is supplied, the blog information is looked up inside the contents of that scalar. Otherwise it's fetched from the network. $blog_page must contain a full HTML page string.

Returns a hashref with the some/all the following information:

link: Something like: http://blog.360.yahoo.com/blog-<yourusername>
sharing: Most probably public. Could also be friends or friends of friends, but never tried it.
count: Number of blog posts in total.
start: First blog post on the frontpage. Should be 1.
end: Last blog post on the frontpage, usually 5.
title: Title of the blog.

`blog_main_page()`

Fetches the user's main blog page. Returns a string with the HTML page contents. This can be used in blog_info() or get_blog_posts().

`blog_page_url($link, $start, $per_page, $count)`

Builds the url to fetch a specific blog page.

`dump()`

Dumps last accessed page content to STDOUT

`login()`

Logs in to Yahoo service. Returns a scalar that tells you if the login was successful or not.

`get_blog_comments(\@posts)`

Retrieves all comments in the user's blog. Wants the structure returned by get_blog_posts().

`get_blogpost_comments($post)`

Retrieves all comments to a single blog post. Wants a single $post entry (hashref): one of the elements returned by get_blog_posts().

`get_blog_posts([$blog_page, [%overrides]])`

Gets all blog posts by a user. If $blog_page is supplied, it looks for blog posts in that page only.

%overrides can be a set passed to override some of the properties about the blog to be scraped and parsed. To see the list of properties, look at blog_info().

Returns an array of hashrefs, each one representing a blog post. Each post (hashref) should have the following keys:

Example:

        $y360 = WWW::Scraper::Yahoo360->new({
                username => '...'
                password => '...',
        });

        $y360->login() or die "Failed login";

        # Fetch only the first blog post, no matter what
        my $first_page = $y360->blog_main_page();
        my $blog_posts = $y360->get_blog_posts($first_page, count=>1);

comments: Number of comments to this blog post
description: Blog post content
link: Permanent URL of the blog post
pubDate: Date when the blog post was published, in HTTP::Date format, ex.: Sun, Nov 14 06:20:28 CET.
tags: Comma delimited string of tags (ex.: travel, holiday)
title: Title of the blog post

`mech()`

WWW::Mechanize object accessor.

`parse_date($date_string)`

Tries to parse a date from the Yahoo 360 format to a unix timestamp.

EXPORTS

None by default.

AUTHOR

Cosimo Streppone, <cosimo@cpan.org>

COPYRIGHT AND LICENSE

This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.8.8 or, at your option, any later version of Perl 5 you may have available.

CPAN RT