My website is wordpress running on cyberpanel server using litespeedcache.
I submitted the sitemap to the google console and edited the robot file, opening the robot file on the browser is normal.
Robot.txt
User-agent: *
Disallow: /wp-admin/
Disallow: /readme.html
Disallow: /license.txt
Disallow: /?s=*
Allow: /wp-admin/admin-ajax.php
Allow: /wp-admin/images/*
Sitemap: https://abc.com/sitemap.xml
Sitemap: https://abc.com/news-sitemap.xml
But check: Your server returned a 5xx (unreachable) error when we tried to retrieve your robots.txt file.
Please help me fix this problem.
Thank you.