Sequentum Enterprise Manual

Introduction

• Introduction

• What is a Sequentum Agent?

• Editions & Licensing

• What is Web Data Extraction / Web Scraping?

• Web Data Extraction with Sequentum Enterprise

• Web Data Extraction Limitations

• Web Data Extraction Techniques

Quick Start with Sequentum Enterprise

• Quick Start with Sequentum Enterprise

• Installing Sequentum Enterprise

• Sequentum Enterprise Basics

• Exploring the Main Window

• Exploring the Menus

• Building Your First Agent

Upgrading to Sequentum Enterprise

• Converting Visual Web Ripper Projects

• Upgrading Content Grabber Premium or Professional from v1 to v2

• Upgrading Content Grabber Agents to Sequentum Enterprise

• Sequentum Rebranding from Content Grabber Enterprise to Sequentum Enterprise

Sequentum Enterprise Editor

• Sequentum Enterprise Editor

• Customizing the Editor Layout

• Working With the Web Browser

• Activity Monitor and Web Request Editor

• Command Configuration

• Copying or Moving Agent Commands

• Selection Tools and Short-Cut Keys

• Navigating an Agent

• Testing/Debugging an Agent

• Scheduling

• Copying & Moving Agents

• Exporting & Importing Agents

• Automated Agent Backups

• Template Libraries

• Default Folders

Selection Techniques

• Selection Techniques

• Editing XPaths Manually

• List Selections

• Selection Anchors

• Sequentum Enterprise XPath Functions

• Multiple Xpaths

• Optimizing Selections

Agent Commands

• Introduction

• Command Library

• Agent Config Files

• Adding Commands Through Config

Error Handling

• Error Handling

• Agent Error Handling

• Error Logs and Notifications

• Email Notifications

• Web Notifications

Extracting Data From Non-HTML Documents

• Extracting Data From Non-HTML Documents

Crawling a Website

• Crawling a Website

Creating Web Cache Using Sequentum Enterprise

• Content Cache in Sequentum Enterprise

Data

• Data

• Database Connections

• The Internal Database

• Using Data Input

• Manage Named Connections

• Exporting Data

• Exporting Data (Legacy/Compatibility Mode)

• Distributing Data

• Removing Duplicate Data

• Extracting New Data Only

• Reusing Existing Data

• Change Tracking

• Data Counting

• Data Validation Screen

Anonymous Web Scraping

• Anonymous Web Scraping

• Fingerprinting & Anonymization Techniques

Monitoring and Compliance

• Obeying Robots Rules

CAPTCHA & IP Blocking

• CAPTCHA & IP Blocking

• CAPTCHA Blocking

• IP Blocking & Proxy Servers

Improving Agent Performance and Reliability

• Improving Agent Performance and Reliability

• Using MS SQL or MySQL as Internal Database

• Using the HTML Parser

• Using the JSON Parser

• Using the XML Parser

• Optimizing Agent Commands

• Performance Sessions

• Multithreading

Running Agents from the Command-Line

• Using the Sequentum Enterprise runtime

• Running Agents from the Command-Line

Running Multiple Instances of the Same Agent

• Running Multiple Instances of the Same Agent

Scripting

• Scripting

• Script Languages

• Python Scripting

• Script Library

• Assembly References

• Script Utilities

• Script Template Library

• Agent Initialization Scripts

• Data Export Scripts

• Data Distribution Scripts

• Transformation Scripts

• Remote Storage File Name Transformation Script

• Proxy Transformation Script

• Data Input Scripts

• Image OCR Scripts

• Convert Document to HTML Scripts

• Custom Scripts

• Condition Scripts

• Command Transformation Scripts

• Executing Python Scripts Using Sequentum Enterprise

• Manipulating the Proxy Pool at Runtime

• Debug Script in Visual Studio

Programming Interface

• Programming Interface

• Building a Desktop Application

• Building a Web Application

• Sessions

• API Access Keys

Website Automation

• Website Automation

• Website Testing & Documentation

Agent Control Center

• Installation & Quick Start

• Login

• Organizations & Users

• Users & their Roles

• Servers & Clusters

• Agent Repository

• Download & Get Data In ACC

• Cluster deployment

• Jobs

• Agent Chaining

• Ticketing System

• Proxy Pools

• Rate Limits

• Audit Trail

• Connections

• API Access

• List of Time Zones

• Upgrading an Existing Version of ACC

• Moving or Recreating an ACC Database

• Connecting a Sequentum Server to the ACC

• Installing Agent Control Center Using PowerShell on Windows Server

• Adding Shared Script Template Library to Agent Control Center

Sequentum Enterprise Command Reference

• Introduction

• Agent Command

Navigation Commands Reference

• Navigate Link

• Navigate URL

• Navigate Pagination

• Crawl Website

• Manual Navigation

• Wait for Content

Web Forms Command Reference

• Set Form Field

Capture Content Commands Reference

• Web Content

• Javascript

• Page Attribute

• Download Image

• Download Document

• Download Video

• Download Audio

• Download Screenshot

• Download Page

• Calculated Value

• Data Value

• Compute Hash

Lists & Data Commands Reference

• Web Element List

• Data List

• Data Table Joins

Group Commands Reference

• Group Commands

• Group Commands in Page Area

Flow Control Commands Reference

• Branch

• Exit or Retry

• Exit If Data Exist

Miscellaneous Commands Reference

• Execute Script

• Transform Page

• Remove Duplicate

• Refresh Document

• Close Browser

• Screenshot Log

Command Templates Reference

• Creating a While Loop

• Resolve Captcha

×