Googlebot is accessing aspx pages it should access SEO-friendly URLs only

0 votes

Googlebot is accessing .aspx pages in my website e.g http://mysite.com/thepage.apx?id=32

I have used Intellgencia URL module for SEO-friendly URLs and my website also has links that present friendly URLs (or extensionless URLs) e.g.: http://mysite.com/thepage/32.

However, googlebot is accessing original URLs (http://mysite.com/thepage.apx?id=32).

In the robot.txt file I have placed following code:

disallow: *.aspx

My question is whether it will hide all pages with .aspx pages and friendly URLs (pointing to same .aspx pages) or hide pages just with .aspx extensions.

Summary:
googlebot is accessing same page with two urls:

  1. With original path e.g somesite/thepage.aspx?id=xx
  2. With friendly URL somesite/somepage/xx I want googlebot to access only friendly URLs. I am using asp.net 2.0 and friendly urls are mapped in web.config using intellgencia dll.

Code in web.config with Intellgencia module.

<rewriter>
    <rewrite url="/category/(.+)" to="/categoryPage.aspx?Id=$1"/></rewrite>
</rewriter>
Feb 19, 2022 in Others by Kichu
• 19,040 points
485 views

1 answer to this question.

0 votes
the url mapping would be wrong that one option to consider in this situation  check aspx urls is also mapped the are supposed to be mapped

or there would be typos in your Disallow statement
answered Feb 20, 2022 by narikkadan
• 63,600 points

Related Questions In Others

+2 votes
2 answers

Is Reactjs SEO friendly? with google bots

Yes, with SERVER-SIDE RENDERING you will not face ...READ MORE

answered Feb 10, 2022 in Others by Shreesh
• 160 points
2,838 views
0 votes
1 answer

Generate SEO friendly URLs (slugs)

function format_uri( $string, $separator = '-' ) {     $accents_regex ...READ MORE

answered Feb 14, 2022 in Others by narikkadan
• 63,600 points
593 views
0 votes
0 answers

Static Pages vs. Dynamic Pages, Which is Better for SEO

which ones better for seo static or ...READ MORE

Feb 18, 2022 in Others by Kichu
• 19,040 points
337 views
0 votes
1 answer

Creating SEO friendly urls using htaccess

its just a simple step just use ...READ MORE

answered Feb 20, 2022 in Others by narikkadan
• 63,600 points
630 views
0 votes
1 answer

Is the single page app in asp.net MVC 4 examples, "Big Shelf", SEO friendly?

the pages that render on the basics ...READ MORE

answered Feb 20, 2022 in Others by narikkadan
• 63,600 points
439 views
0 votes
1 answer

SEO-friendly React-Redux app build

actually best choice is to use Nextjs ...READ MORE

answered Feb 24, 2022 in Others by narikkadan
• 63,600 points
638 views
0 votes
1 answer

Authenticate on an ASP.Net Forms Authorization website from a console app

Essentially, we need to record a regular ...READ MORE

answered Sep 20, 2018 in IoT (Internet of Things) by Annie97
• 2,160 points
911 views
0 votes
1 answer

Googlebot is accessing .aspx pages, it should access SEO-friendly URLs only

google bot will find  it if you ...READ MORE

answered Feb 11, 2022 in Others by narikkadan
• 63,600 points
471 views
0 votes
1 answer

Googlebot is accessing .aspx pages, it should access SEO-friendly URLs only

the URL mapping you have done would ...READ MORE

answered Feb 24, 2022 in Others by narikkadan
• 63,600 points
572 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP