User-Agent: *
Allow: /
Crawl-delay: 5

User-Agent: BUbiNG
User-Agent: Rogerbot
User-Agent: Exabot
User-Agent: MJ12bot
User-Agent: Dotbot
User-Agent: Gigabot
User-Agent: AhrefsBot
User-Agent: BlackWidow
User-Agent: Bot [EMAIL="craftbot@yahoo.com"]mailto:craftbot@yahoo.com[/EMAIL]
User-Agent: ChinaClaw
User-Agent: Custo
User-Agent: DISCo
User-Agent: Download Demon
User-Agent: eCatch
User-Agent: EirGrabber
User-Agent: EmailSiphon
User-Agent: EmailWolf
User-Agent: Express WebPictures
User-Agent: ExtractorPro
User-Agent: EyeNetIE
User-Agent: FlashGet
User-Agent: GetRight
User-Agent: GetWeb!
User-Agent: Go!Zilla
User-Agent: Go-Ahead-Got-It
User-Agent: GrabNet
User-Agent: Grafula
User-Agent: HMView
User-Agent: HTTrack
User-Agent: Image Stripper
User-Agent: Image Sucker
User-Agent: Indy Library
User-Agent: InterGET
User-Agent: Internet Ninja
User-Agent: JetCar
User-Agent: JOC Web Spider
User-Agent: larbin
User-Agent: LeechFTP
User-Agent: Mass Downloader
User-Agent: MIDown tool
User-Agent: Mister PiX
User-Agent: Navroad
User-Agent: NearSite
User-Agent: NetAnts
User-Agent: NetSpider
User-Agent: Net Vampire
User-Agent: NetZIP
User-Agent: Octopus
User-Agent: Offline Explorer
User-Agent: Offline Navigator
User-Agent: PageGrabber
User-Agent: Papa Foto
User-Agent: pavuk
User-Agent: pcBrowser
User-Agent: RealDownload
User-Agent: ReGet
User-Agent: SiteSnagger
User-Agent: SmartDownload
User-Agent: SuperBot
User-Agent: SuperHTTP
User-Agent: Surfbot
User-Agent: tAkeOut
User-Agent: Teleport Pro
User-Agent: VoidEYE
User-Agent: Web Image Collector
User-Agent: Web Sucker
User-Agent: WebAuto
User-Agent: WebCopier
User-Agent: WebFetch
User-Agent: WebGo IS
User-Agent: WebLeacher
User-Agent: WebReaper
User-Agent: WebSauger
User-Agent: Website eXtractor
User-Agent: Website Quester
User-Agent: WebStripper
User-Agent: WebWhacker
User-Agent: WebZIP
User-Agent: Wget
User-Agent: Widow
User-Agent: WWWOFFLE
User-Agent: Xaldon WebSpider
User-Agent: Zeus
Disallow: /

Sitemap: https://www.yavlena.com/sitemap_index.xml
Sitemap: https://www.yavlena.com/sitemap_en_index.xml
Sitemap: https://www.yavlena.com/sitemap_ru_index.xml