Omniracle Bot Crawler Rules
Omniracle Bot is a crawler program designed to serve Omniracle AI Search. This document aims to explain the crawling rules of Omniracle Bot and the cooperation with website owners.
Robots.txt Compliance
Omniracle Bot strictly adheres to the rules specified in the robots.txt file. If a website owner modifies the robots.txt file, Omniracle Bot will update its crawling rules within 7 days to comply with the new requirements. Website owners can control whether Omniracle Bot crawls their content by setting rules in the robots.txt file.
Rate Limiting
To respect the server load of websites and use network resources reasonably, Omniracle Bot has implemented a rate limiting mechanism. The crawling frequency for each website will not exceed once per second to ensure that the crawling activities do not have a significant impact on the website's performance.
Data Usage
The text, images, and URLs crawled by Omniracle Bot will be displayed on the search results page of Omniracle AI Search for users to click and view. This data will help Omniracle AI Search provide more comprehensive and accurate search results, enhancing the overall search experience for users.
Traffic Source
The website content crawled by Omniracle Bot will be showcased on the search results page of Omniracle AI Search, providing a traffic source for websites. Website owners can receive traffic from Omniracle AI Search on omniracle.com, bringing more visits and exposure to their websites.
Reward Program
Omniracle believes that websites providing valuable content should be rewarded. Therefore, we plan to introduce a reward program in the future to support websites that offer high-quality content. This initiative aims to incentivize website owners to continue providing beneficial information and enhance the quality of online content.
Omniracle Bot will continue to adhere to the above rules and maintain a good cooperative relationship with website owners. Thank you for supporting Omniracle AI Search, and we look forward to collaboratively creating a richer and more beneficial online environment.
The above is a detailed explanation of the Omniracle Bot crawler rules. If you have any questions or need further clarification, please feel free to reach out to us. Thank you for reading!