Featured products and servicesadvertise here
ForumsW3TechsContent Management Server-side Languages Client-side Languages JavaScript Libraries CSS Frameworks Web Servers Web Panels Operating Systems Web Hosting Data Centers Reverse Proxies DNS Servers Email Servers SSL Certificate Authorities Content Delivery Traffic Analysis Tools Advertising Networks Tag Managers Social Widgets Site Elements Structured Data Markup Languages Character Encodings Image File Formats Top Level Domains Server Locations Content Languages This ForumNew Topiconly registered users can post in the forums |
W3Techs Forumenterprise domainsTom McIntyre on 18 November 2019, 6 years ago Our organization uses a single domain name for most of sites in the enterprise. Each site in turn has a sub-domain name. The organization is the National Association of Watch & Clock Collectors and the domain is nawcc.org. Our forum site is mb.nawcc.org while our publishing site is nawcc.org. Each site has its own ip address. Our membership security system is nawcc.net and there are a few other specialized sites that have their own domain name. Is there some reason that the sites on sub-domains cannot be treated independently for crawling? Or, is this just a convention? When I tried to crawl mb.nawcc.org, which is a XenForo forum site, your system reported nawcc.org and did not see the forum site. Sam Soltano (site administrator) on 18 November 2019, 6 years ago Hi Tom Thank you for your feedback. We typically do not crawl all the pages and all the subdomains of a site, primarily due to capacity restrictions. You need to be logged in to reply. |