robots txt file in SEO

  • 4 Replies
  • 284 Views

0 Members and 1 Guest are viewing this topic.

Offline Anon

  • *
  • Fractal Fluff
  • *****
  • Posts: 354
« on: September 15, 2017, 07:31:32 PM »
What is the use of robots txt file in SEO?   Robots.txt is a text file webmasters create to instruct web robots (typically search engine robots) how to crawl pages on their website.

Still showing https://www.fractalforums.org as first item in search results
Anyone know how to fix this?

See attached images...

Linkback: https://fractalforums.org/discuss-fractalforums/5/robots-txt-file-in-seo/315/
« Last Edit: October 07, 2017, 08:25:08 AM by Anon »

Offline Fraktalist

  • *
  • Administrator
  • *******
  • Strange Attractor
  • Posts: 1148
« Reply #1 on: September 15, 2017, 08:21:37 PM »
added stuff to .htaccess, www now redirects to non-www.
Let's see if this helps.

thanks for noticing.

Offline Anon

  • *
  • Fractal Fluff
  • *****
  • Posts: 354
« Reply #2 on: September 15, 2017, 10:03:40 PM »
Almost there.

https://www.fractalforums.org/ takes me to http://fractalforums.org

See attached...
« Last Edit: September 15, 2017, 11:27:37 PM by Anon »

Offline Fraktalist

  • *
  • Administrator
  • *******
  • Strange Attractor
  • Posts: 1148
« Reply #3 on: September 19, 2017, 03:45:00 PM »
I have no clue why this is. the rewrite rule in htaccess is correct and exactly as the hoster recommends.
It works properly for everything, except that special https://www.fractalforums.org/ url.


That url itself seems unusable, I can't even login using it. "Unable to verify referring url. Please go back and try again."
And wherever I navigate using that URL it switches to the correct one after the first click.

Any ideas?

Offline Anon

  • *
  • Fractal Fluff
  • *****
  • Posts: 354
« Reply #4 on: September 20, 2017, 12:05:12 AM »
I do not know how any of this actually works.
I just notice discrepancies.

Can the underlying forum and htaccess code be searched for the string www.fractal?


xx
Opening a map-file gives 'Invalid parameter file'.

Started by fractal on Kalles Fraktaler

2 Replies
89 Views
Last post August 09, 2019, 08:31:29 AM
by fractal
xx
kfb file format

Started by gerrit on Kalles Fraktaler

2 Replies
291 Views
Last post January 09, 2018, 06:11:45 PM
by gerrit
xx
file types

Started by Adam Majewski on Kalles Fraktaler

1 Replies
401 Views
Last post September 19, 2017, 11:21:30 PM
by claude
xx
pdf file in japan

Started by Adam Majewski on Fractal Mathematics And New Theories

10 Replies
526 Views
Last post December 01, 2017, 11:05:31 PM
by gerrit
xx
Difference between m3i and m3p file formats?

Started by zxs on Mandelbulb3d

3 Replies
311 Views
Last post May 09, 2019, 12:02:37 AM
by Sabine62