Crawler

Updated on 12 Aug 2023
2 Minutes to read

Share
Dark
Light
PDF

Article summary

Did you find this summary helpful?

Thank you for your feedback

Note:

This article showcases features that are typically only made available to Administrator roles.

However, since Getac Enterprise is highly configurable, the ability to complete tasks described in this article may be different for each User, depending on policy. Please contact an administrator with all access questions and concerns.

Warning:

The information listed here is to explain this feature. This is configured by the Getac implementation teams and should NOT be modified without first contacting support@getacvideo.com. Getac is not responsible for data loss or interruption of services due to improper configuration of this feature.

Overview

The Crawler feature has management options to control crawl schedules, create new search crawler jobs, and review search logs. The page header contains important KPI information related to the search crawler.

See the image below for how to access the Crawler page:

Ex. Crawler Page

The page body is divided into three tabs sections:

Schedulers.
Jobs.
Logs.

Schedulers

From the Schedulers tab, both the short and long crawl schedules can be modified and paused. Administrators can also monitor the scheduler status and the number of jobs assigned to each scheduler.

See the image below for an example:

Ex. Scheduler tab

To modify a scheduler, perform the following steps:

Click the Pen icon in the top-right of the scheduler group to edit.
In edit mode, change the number of dedicated threads to the desired number.
Click the Checkbox icon to confirm, or the Cancel icon to cancel.

See the image below for an example:

Ex. Modify Scheduler

Click the Power button to start or stop the scheduler service. A prompt to confirm the action and a notification will appear when the service is successfully stopped or started.

See the image below for an example:

Ex. Scheduler start/stop button

Jobs

The Jobs Tab lists all available jobs with management tools to modify, create, and start/stop crawler jobs.

See the image below for an example:

Ex. Jobs tab

Create new Job

To add a new Job, perform the following steps:

Click on the Page icon on the right side of the screen.
Ex. Add new Job button
Set the Job Instance parameters and click on Save to finalize.
Ex. Job instance parameters

Parameters include the following:

Job Type - See the Job Types list below for available jobs.
Scheduler Type - Assign to the short or long scheduler.
Job Name - The simple description of the job being created.
Job Group - Specify if the job will run under the short or long term schedulers.
Parameters - Custom parameters provided by Getac. Contact support@getacvideo.com for assistance.
Interval Type - Choose Interval or Absolute.
- Interval -Set the interval value in Days, Hours, Minutes, and Seconds.
- Absolute - Set the time value in hours, minutes, seconds (HH:MM:SS) and select which day(s) or Everyday in the Days field.
- Start Date/Time - Set the Date and Time when the job will first begin. Either manually type the date/time or click the Calendar icon to pick the date, then the Clock icon to pick the time.
Execute on Secondary - If running multiple crawlers, forces job to run on the secondary crawler.
Save/Cancel - Commit or Discard your changes by using the Create/Save and Cancel buttons.