View on
MetaCPAN
search.cpan.org is shutting down
For details read Perl NOC. After June 25th this page will redirect to MetaCPAN.org
Tom Gracey > TaskPipe-0.01

TaskPipe-0.01

This Release TaskPipe-0.01  [Download] [Browse 13 May 2018
Latest Release TaskPipe-0.03  [Download] [Browse 16 May 2018
Other Releases
Links Discussion Forum ] [ View/Report Bugs (1) ] [ Dependencies ] [ Other Tools ]
CPAN Testers PASS (90)   [ View Reports ] [ Perl/Platform Version Matrix ]
Rating      (0 Reviews) [ Rate this distribution ]
License The GNU General Public License, Version 3, June 2007
Special Files
Changes
Makefile.PL
MANIFEST
META.json
README

Modules

TaskPipe A task management framework for building web scrapers and crawlers      
TaskPipe::DaemonManager manage TaskPipe background processes      
TaskPipe::FileInstaller handles file installs for TaskPipe      
TaskPipe::InterpParam Parameter value interpolator for TaskPipe      
TaskPipe::InterpParam::MatchHandler      
TaskPipe::InterpParam::MatchHandler_id      
TaskPipe::InterpParam::MatchHandler_name      
TaskPipe::InterpParam::MatchHandler_this      
TaskPipe::InterpParam::Parts      
TaskPipe::Iterator generic class for TaskPipe Iterators      
TaskPipe::JobManager manages TaskPipe jobs      
TaskPipe::JobManager::Settings settings for the TaskPipe::JobManager module      
TaskPipe::LoggerManager Logging manager for TaskPipe      
TaskPipe::LoggerManager::Settings settings for the TaskPipe::LoggerManager module      
TaskPipe::OpenProxyManager open proxy management for TaskPipe      
TaskPipe::OpenProxyManager::IPList the base class for IPLists      
TaskPipe::OpenProxyManager::IPList::Settings      
TaskPipe::OpenProxyManager::IPList_PremProxy PremProxy IP List      
TaskPipe::OpenProxyManager::IPList_PremProxy::Settings      
TaskPipe::OpenProxyManager::IPList_ProxyNova ProxyNova IP List      
TaskPipe::OpenProxyManager::IPList_ProxyNova::Settings      
TaskPipe::OpenProxyManager::IPList_Xroxy Xroxy IP List      
TaskPipe::OpenProxyManager::IPList_Xroxy::Settings      
TaskPipe::OpenProxyManager::Settings      
TaskPipe::PathSettings Path settings for TaskPipe      
TaskPipe::PathSettings::Global TaskPipe global path settings      
TaskPipe::PathSettings::Project project path settings for TaskPipe      
TaskPipe::Plan manage plan files for TaskPipe      
TaskPipe::Plan::Settings settings for TaskPipe::Plan      
TaskPipe::PodReader read POD for TaskPipe      
TaskPipe::PodReader::Settings Settings for TaskPipe::PodReader      
TaskPipe::PortManager manage ports for TaskPipe      
TaskPipe::Role::MooseType_IterateMode      
TaskPipe::Role::MooseType_OutputMode      
TaskPipe::Role::MooseType_PlanMode      
TaskPipe::Role::MooseType_ScopeMode      
TaskPipe::Role::MooseType_ShellMode      
TaskPipe::Role::MooseType_StrArrayRef      
TaskPipe::Role::MooseType_UserAgentType      
TaskPipe::Role::RunInfo      
TaskPipe::RunInfo      
TaskPipe::Sample      
TaskPipe::Sample_SP500      
TaskPipe::Sample_Stubs      
TaskPipe::SchemaManager manage schema connections for TaskPipe      
TaskPipe::SchemaManager::Settings settings for TaskPipe::SchemaManager      
TaskPipe::SchemaManager::Settings_Global global schema settings for TaskPipe      
TaskPipe::SchemaManager::Settings_Project project schema settings for TaskPipe      
TaskPipe::SchemaTemplate_Global Global Schema Template for TaskPipe      
TaskPipe::SchemaTemplate_Global::Result::Daemon      
TaskPipe::SchemaTemplate_Global::Result::Job      
TaskPipe::SchemaTemplate_Global::Result::OpenProxy      
TaskPipe::SchemaTemplate_Global::Result::Port Global Schema Template file for port source      
TaskPipe::SchemaTemplate_Global::Result::Spawned      
TaskPipe::SchemaTemplate_Global::Result::Thread      
TaskPipe::SchemaTemplate_Project Project Schema Template for TaskPipe      
TaskPipe::SchemaTemplate_Project::Result::Error      
TaskPipe::SchemaTemplate_Project::Result::Pinterp      
TaskPipe::SchemaTemplate_Project::Result::Result      
TaskPipe::SchemaTemplate_Project::Result::ResultGroup      
TaskPipe::SchemaTemplate_Project::Result::Run      
TaskPipe::SchemaTemplate_Project::Result::XBranchError      
TaskPipe::SchemaTemplate_Project::Result::Xbranch      
TaskPipe::SchemaTemplate_Project_SP500      
TaskPipe::SchemaTemplate_Project_SP500::Result::Company      
TaskPipe::Task the class which all TaskPipe tasks should inherit from     0.01
TaskPipe::Task::ModuleMap      
TaskPipe::Task::Settings Settings for TaskPipe::Task      
TaskPipe::Task::TestSettings test settings for TaskPipe::Task      
TaskPipe::Task_Record record a record to the database      
TaskPipe::Task_Record_NameValuePairs      
TaskPipe::Task_Scrape Base TaskPipe class for scraping a webpage      
TaskPipe::Task_Scrape::Settings settings for TaskPipe::Task_Scrape      
TaskPipe::Task_SourceFromDB use a database table as the data source      
TaskPipe::Task_SourceFromFile use a file as a data source      
TaskPipe::Template the base class for file templates      
TaskPipe::Template_Config      
TaskPipe::Template_Config_Global template for the global config file      
TaskPipe::Template_Config_Project template for the project config      
TaskPipe::Template_Config_Project_SP500      
TaskPipe::Template_Config_System the template package for the 'system' config file      
TaskPipe::Template_Plan      
TaskPipe::Template_Plan_SP500      
TaskPipe::Template_Plan_Stub      
TaskPipe::Template_Task      
TaskPipe::Template_Task_SP500ScrapeCompanies      
TaskPipe::Template_Task_SP500ScrapeQuote      
TaskPipe::Template_Task_ScrapeStub      
TaskPipe::ThreadManager manages threads for TaskPipe      
TaskPipe::Tool the base class for the TaskPipe command line tool     0.01
TaskPipe::Tool::Command base class for TaskPipe Tool commands      
TaskPipe::Tool::Command_ClearTables      
TaskPipe::Tool::Command_DeployFiles      
TaskPipe::Tool::Command_DeployTables      
TaskPipe::Tool::Command_GenerateSchema      
TaskPipe::Tool::Command_RunPlan      
TaskPipe::Tool::Command_Setup      
TaskPipe::Tool::Command_ShowJobs      
TaskPipe::Tool::Command_StopJob      
TaskPipe::Tool::Command_TestTask      
TaskPipe::Tool::Command__OpenProxies      
TaskPipe::Tool::Command__OpenProxies_FetchOpenProxies      
TaskPipe::Tool::Command__OpenProxies_TestOpenProxies      
TaskPipe::Tool::Options      
TaskPipe::TorManager manage TOR processes for TaskPipe      
TaskPipe::TorManager::Settings settings for TaskPipe::TorManager      
TaskPipe::UserAgentManager base class for managing requests in TaskPipe      
TaskPipe::UserAgentManager::CheckIPSettings      
TaskPipe::UserAgentManager::Settings      
TaskPipe::UserAgentManager::UserAgentHandler      
TaskPipe::UserAgentManager::UserAgentHandler::Settings      
TaskPipe::UserAgentManager::UserAgentHandler_PhantomJS      
TaskPipe::UserAgentManager::UserAgentHandler_PhantomJS::Settings      
TaskPipe::UserAgentManager::UserAgentHandler_WhoIs      
TaskPipe::UserAgentManager_ProxyNet      
TaskPipe::UserAgentManager_ProxyNet_Open useragent manager for making requests through an open proxy network      
TaskPipe::UserAgentManager_ProxyNet_TOR useragent manager for making requests through TOR      

Documentation

TaskPipe::InterpParam::MatchHandler_this;  
TaskPipe::Manual::Overview An overview of the TaskPipe framework  
TaskPipe::MatchHandler handling matching of parameter values in the plan  
TaskPipe::ModuleMap  
TaskPipe::SchemaTemplate_Global::Result::Daemon;  
TaskPipe::SchemaTemplate_Global::Result::TorThread  
TaskPipe::UserAgentHandler_PhantomJS useragent handler for phantomjs  
TaskPipe::UserAgentManager::ProxyNet base class for proxying useragents  
TaskPipe::UserAgentManager::UserAgent::Handler  
lib/TaskPipe/Manual/Installation.pod  
taskpipe script to execute the TaskPipe Tool