![]() | |
![]() | |
![]() |
SEO Information |
|
![]() |
Release from Google Sandbox Only to Search the Playground
The Google Sandbox Effect has been discussed at length in ourcase study of a new website first crawled in May by Googlebot.We can now further the case study with indexing comparisonsand discuss interesting Googlebot crawler behavior afterrelease, at the 75 day mark, of the study website from thatvery confining Sandbox. This case study is not for the faint of heart - those justlaunching a new web business on a new domain name with hopesof instant indexing and immediate traffic may find theirwebsite very lonely for two and a half months - if it is in acompetitive market segment. You may as well plan to stay inthe Google Sandbox for at least 45 days on average. If someearly release stories are to be believed, search phrasesnobody wants to play with are taken pity on by Google and senthome for early release. Those non-competitive or obscure search phrases seem to beseen as good, quiet little children, playing by themselves inSandbox playground and are sent home early on good behavior.Googlebot probably sees good behavior as playing well withothers, like a good little baby domain and NOT beingcompetitive as some young domains can be. Throwing sand inother childrens' faces and insisting on having your siteindexed, throwing sand out of the Sandbox with your brightplastic toy shovel and bucket will not be allowed. Now that the site discussed in this study is out of theSandbox, it still lingers on the playground, unable to escapethe community park and leave for the business world to playwith the big boys in the outside world. It does indeed taketime to grow up and be the model citizen in this new searchplayground. Though on the first full day after this first weekof being released from the sandbox, the site has gotten 68visitors referred by searches done at Google, the firstreferred search traffic coming into the site. MSN has sent 8visitors, Yahoo has sent 6, 4 came from AOL searches, 2 fromNetscape and 1 from Dogpile. The indexing behavior of Yahoo and MSN has been nothing shortof bizarre with numbers of indexed pages increasing rapidlyover the first two months to reflect 6,941 pages indexed until8 weeks into this study and we outlined previously how numberschanged as you click through results pages first upward, thendownward to about half the total of highest numbers listedalong the top of the results pages. It appears that Yahoo and MSN are playing on the 'slipperyslide' in this playground, climbing to the top of the ladderof results at about 10 week mark showing 8,210 and 6,941 pagesrespectively indexed, then sliding down again to 3,510 forYahoo and 373 for MSN, as of this writing two weeks later onAugust 6. Still, Yahoo will show you only 1,000 (100 pages) ofthose results and MSN will show you only 250 results, or 25pages, no matter how many they claim to index. MSNbot iscrawling the site faster and more consistently than any of theengines, yet shows by far fewer pages indexed than the others. One of the interesting comparisons between Google and MSN inour Sandbox study is that Google will show you most of whatthey claim to have indexed after you click that link at thebottom of the first page showing only 3 or 4 results when youuse the "site:Publish101.com" query operator then go to thebottom of the page and click the link under the line reading,"In order to show you the most relevant results, we haveomitted some entries very similar to the 3 already displayed.If you like, you can repeat the search with the omittedresults included." Go ahead and click that link, then you'll be presented withthe claimed total of indexed pages. That number has verysteadily increased since Sandbox release after 75 days fromfirst crawling of this Sandbox study site. The timing andnumbers of indexed pages at Google goes upward, and ONLYupward with VERY distinct patterns noted from raw log files.Crawling schedules seem to have been established for this siteby Google and indexing changes occur on a very regularschedule. The first observation of Sandbox release was at noon onThursday July 28, seventy-five days from first crawling byGooglebot when a search turned up 379 pages indexed with a"site:Publish101.com" query. That number increased later thesame evening to 3,660 pages at a search done around the dinnerhour Pacific time. Oddly, the next day, Friday July 29, thenumber took a slight hop upward to 3,700 pages and on thefollowing Monday, showed 3,770 pages indexed. That schedule and pattern have repeated on the second week ofSandbox release when a "site:Publish101.com" query produced5,660 results from from Google for the site on Thursday August4 at just after noon and then nearly doubled at around thedinner hour to 10,700 pages on that same query. A final checkjust now on Saturday shows it at 12,100 pages indexed byGoogle. It should be pointed out to those who wonder about thetotal number of pages that this is a dynamic site with a verylarge archive of articles that increases daily as newsubmissions are contributed by member authors at the site. Those articles are added through a content management systemon a daily basis by an editor who reviews submissions andprocesses them for approvals or rejections. Those approved aremade live from the home page nightly. We've started doing thison the crawler's schedules as we've noted very regular visitsby Yahoo's Slurp crawler to the site home page just once dailyat around 5pm each evening and Googlebot visiting the homepage only once, at near 11pm nightly, so we've instituted amidnight activation of each day's new article submissions onthe home page of the site so that none of the new pages aremissed by those crawlers. MSNbot seems to hit the home pagemultiple times through the day, so timing is less importantfor MSN. Crawler activity has been heated, with Yahoo crawling theleast and the slowest, barely seeming to attempt any updatesand the total of indexed pages has not changed for over threeweeks since it peaked at 8,210 pages indexed and then droppedto it's current level of 3,510. As previously stated, Slurpseems to be unhindered by any form of consistency in indexingor crawling behavior. MSNbot has crawled extensively andfairly regularly for weeks, but that odd indexing behavior isa serious flaw in their utility as a search tool. It should be mentioned here that AskJeeves had been noted tocrawl the site extensively early in this case study anddisplayed a very regular and consistent crawl, but stoppedabruptly three weeks ago on july 13, after hitting most of thepages then available on the site. Teoma, their spider, hasbeen absent ever since and they have not indexed this domainat all since first crawling on May 23, over 10 weeks ago.Clearly, Teoma appears to have the longest Sandbox of all thesearch engines. Much has been learned in this Sandbox case study about crawlerbehavior, indexing delays, robots.txt requirements and indexupdates at each of the top three search engines. Where thatknowledge leads will, of course, change as algorithms andcrawling schedules are adjusted by MSN, Yahoo and Google. Butvaluable information has been shared that may help otherwebmasters to better understand each of the factors thatdetermine the success of any website. "Further findings in follow-up articles at the 3, 6 and 9month marks, explore search referrals gained as Google addsmore pages and rankings fluctuations begin to level.Meanwhile, we'd like to encourage others to publicly review their crawler traffic through logs to compare behavior on newdomains to verify findings and disclose indexing behavior and timing for new domains and further document SE indexing as well as crawling behavior. Copyright © August 6, 2005 Previous Sandbox Case Study Articles: http://Publish101.com/Sandbox2 http://Publish101.com/Sandbox3 http://Publish101.com/Sandbox4 Mike Banks Valentine is a search engine optimizationspecialist
MORE RESOURCES: Generative AI Is Changing SEO Forever — Here's What You Need to Know to Stay Competitive Entrepreneur Robots.txt and SEO: What you need to know in 2025 Search Engine Land Google Explains SEO Impact Of Adding New Topics Search Engine Journal Google April Post Core Update Ranking Volatility Heats Up Search Engine Roundtable K-drama star Seo Ye Ji’s cyberbully identified with ties to Kim Soo Hyun’s agency The Indian Express FlowChai Launches Advanced AI-Powered Platform to Upends SEO Content Creation Through Natural Language Conversations Yahoo Finance Indexing and SEO: 9 steps to get your content indexed by Google and Bing Search Engine Land Seo Ye Ji’s defamer identified by new agency with a Kim Soo Hyun twist; police complaint file Pinkvilla How To Apply E-E-A-T To Your Site & Boost On-Page SEO Search Engine Journal Keyword ranking is most popular metric among SEO professionals amid concern over algorithm changes Exploding Topics FlowChai Launches Advanced AI-Powered Platform to Upends GlobeNewswire 55 AI SEO Statistics That Reveal the Future of Search Influencer Marketing Hub SEO priorities for 2025: Your guide to search success Search Engine Land 7 SEO Tips to Improve Your Crypto Site’s Ranking in 2025 Suffolk Gazette Free SEO Tools That I Use to Rank in 2025 Exploding Topics How to Use ChatGPT to Support Link Building: Boost Your SEO in 2025 Influencer Marketing Hub Google’s Mueller Cautions SEO Pros On Changing Business Needs Search Engine Journal On-Page SEO Services for Local Business Websites Rocks Digital How to integrate GEO with SEO Search Engine Land Top SEO Trends for Local Propane Delivery Companies in 2025 Butane Propane News Pagination and SEO: What you need to know in 2025 Search Engine Land BrandPilot AI to Launch AI-Powered SEO Platform, Expanding Its Suite of Search Marketing Tools Newsfile Ask An SEO: If I Am Not An SEO Expert, Is It Better For Me To Start An Agency? Search Engine Journal SEO Optimization Tools Trend Hunter How generative information retrieval is reshaping search Search Engine Land National team member Jeong Min-seo has confirmed her advance to the Augusta National Women's Amateur.. ë§¤ěťĽę˛˝ě ś Google’s Martin Splitt Reveals 3 JavaScript SEO Mistakes & Fixes Search Engine Journal Search Magic Achieves 170% Organic Revenue Growth for E-Commerce Client with SEO Strategy openPR.com Q2 SEO & AI Update: How To Track & Optimize AI Search Performance Search Engine Journal How to use OpenAI’s Deep Research for smarter SEO strategies Search Engine Land SEO in a Zero-Click World ClickZ Seo Kang-joon steals spotlight in 'Undercover High School,' but critics call for greater depth The Korea Times 8 common SEO mistakes to avoid Search Engine Land “Made in Canada” has become one of the most searched terms in the past two months. Search Engine People Do exact match domains have value in 2025? Search Engine Land 4 SEO tips to boost click-through rate Search Engine Land How to use ChatGPT Tasks for SEO Search Engine Land Top 15 SEO Tools to Improve Your Search Rankings Exploding Topics Actor Seo Yea-ji to host new season of SNL Korea Korea JoongAng Daily 130 SEO Statistics Every Marketer Must Know in 2025 Exploding Topics 5 SEO content pitfalls that could be hurting your traffic Search Engine Land Park Seo-jin's family enters Hyo-jung's search for laughter.In KBS 2TV's "Salim Men Season 2" (herei.. ë§¤ěťĽę˛˝ě ś SEO then vs now: Do the old rules still hold up in the AI era? Performance Marketing World Multilingual and international SEO: 5 mistakes to watch out for Search Engine Land AI & SEO: How Artificial Intelligence Is Already Shaping the Future of Search Engine Optimization ResearchFDI Professor Seo Kyung-duk condemns illegal viewing of tangerines series in China - CHOSUNBIZ Chosun Biz Guest Post: SEO in 2025 - Google algorithm updates, the role of AI, and search engine ranking growth Travolution Song Jin-woo and Choi Ye-na oust Seo Hyun-cheol in fight for family freedom - CHOSUNBIZ - Chosun Biz The Best SEO Conferences For 2025 (Virtual And In-Person) Search Engine Journal The shift to semantic SEO: What vectors mean for your strategy Search Engine Land SEO Must Solve Its Marketing Problem Forrester 6 easy ways to adapt your SEO strategy for stronger AI visibility Search Engine Land Is Compression A Google SEO Myth? Search Engine Journal Google Shares Valuable SEO Takeaway About Quality Raters Guidelines Search Engine Journal Tech Savy Crew Launches 360° SEO Solution to Drive Business Growth and Dominate Search Rankings GlobeNewswire Is SEO Always Changing? Not Really But Details Do. Search Engine Roundtable Google: Poor Pingdom Score Does Not Affect Your SEO Search Engine Roundtable AI & SEO: How to Prepare in 2025 Exploding Topics Google Search Central Live NYC: Insights On SEO For AI Overviews Search Engine Journal 10 Facebook SEO Strategies for 2025 DesignRush Google’s SEO Tips For Better Rankings – Search Central Live NYC Search Engine Journal Dental practice takes DIY approach to local healthcare SEO The Sunshine Valley Gazette 7 reasons why we love SEO Search Engine Land Seo Yea-ji confronts defamation as former staff member spreads false rumors - CHOSUNBIZ - Chosun Biz Google’s March Core Update: Early Observations From Initial Rollout Search Engine Journal Automate SEO analysis with Google Sheets, GSC & ChatGPT API Search Engine Land Why SEO is still key to visibility on search, social, and AI platforms Search Engine Land How to Improve Pinterest SEO in 2025 Metricool International SEO: Everything you need to know in 2025 Search Engine Land 9 Top AI SEO Tools & How to Use AI for Writing and More Exploding Topics SEO for ChatGPT search: 4 key observations Search Engine Land 14 Monthly SEO Tasks to Get More Traffic in 2025 Exploding Topics Google March 2025 Core Update Volatility Heats Up At Tail End Of Update Search Engine Roundtable Top 10 SEO expert columns of 2024 on Search Engine Land Search Engine Land Optimizing LLMs for B2B SEO: An overview Search Engine Land National team member Jung Min-seo started the Augusta National Women's Amateur in a good mood. Jung ë§¤ěťĽę˛˝ě ś DeepSeek & SEO: What you need to know Search Engine Land Technical SEO post-migration: How to find and fix hidden errors Search Engine Land |
![]() |
![]() |
![]() |
RELATED ARTICLES
Expert Help From Google Answers Web users turn to search engines for answers to their questions. This is usually done through various levels of searching the engine's database. The Business Case for SEO It's interesting how potential clients have preconceived notions about which aspects of search engine marketing have the most value. In fact, they tend to fall into two camps that are 180° apart. Google Loosing Fan Base? "Nothing last forever but the Earth and sky." - from Dust in the Wind by Kansas. PPC Advertising - The First Step In A SEO Marketing Campaign Often, sites view seo and PPC marketing as exclusive marketing techniques. Each marketing method has its advocates. Designing a Better System for Search Engines Designing a Better System for Search Engines and Information Distribution, information and knowledge are power. Having run out of things to study today, I thought about Researching and Research. What are My Chances to Get the First Place in Search Engine Listings? You must have heard the stories how people became rich and famous with their websites. How could they achieve this? Their websites took a first position in search engine listings targeting popular keywords. Work With The Search Engines - Dont try to Outsmart the Search Engines Contrary to the claims of high-priced SEO firms, optimizing yourweb site for search engines is not brain surgery. But youmust first accept the fact that "spiders" - the search engineprograms that read web pages - run away from non-HTML code. Promoting Home Business: Tips to Increase Web Site Sales You've selected an appropriate Online Business Opportunity. That is not ALL!To run a successful online ecommerce Home business, getting the targetted users to visit your site and converting them into customers is the first and foremost thing. Top 2 Ways To Get Higher Rankings in Major Search Engines Top 10 search engine rankings. Everybody wants it but a few achieve it. Complete Web-Site Optimization For Search Engines (Part 1) SEO or search engine optimization strategy now becomes widely popular among online business operators. Nothing strange about it as it allows to substantially increase your gross income, as a result of growing traffic or visitors flow. Page Rank Purgatory - Simple Things You can Do to Keep Your Web Site Out of Search Engine Hell! Are Meta Tags Really Dead?Right in their Guidelines Yahoo Tells You that Meta-Tags are Not Totally Dead and Buried(The Below Information was Taken Directly From the Yahoo Help File http://help.yahoo. Google, Adsense, SEO, and How It All Works Google uses an algorithm to determine the search engine results (SERPS). The algorithm is based upon certain factors that include keyword density, Meta Tags, anchor tags, image tags, back links, etc etc etc. Offpage Optimization: Does Article Marketing Cut the Mustard? For those who haven't heard: article marketing is the new offpage optimization strategy that works like magic and won't cost you a dime. What's the strategy? You create an arsenal of short, well-written keyword articles aimed at your target customer and include your URL at the bottom. Ten Steps To A Well Optimized Website - Step 3: Site Structure Welcome to part three in this search engine positioning series. Last week we discussed the importance and considerations that much be made while creating the content that will provide the highest ROI for your optimization efforts. Use Keyword Articles for Search Engine Optimization Search engine optimization is very important for your online business if you are interested in staying in business. The reason for this is most of the time the large search engines direct traffic to your website, however your website must include what the search engine is looking for in order for your web page to be returned as a result. Maximize Your Search Engine Traffic - 13 Ways to Pull in More Visitors From the Search Engines Maximizing traffic from the search engines to your web site is not a difficult task but it does require you to think ahead and plan your Search engine optimization strategy carefully. If you have not yet built your web site and are still in the initial planning stages then you may have an easier time of it. Googles Good-Writing Filter I was recently struck by the fact that the top-ranking web pages on Google are consistently much better written than the vast majority of what one reads on the web. Yet traditional SEO wisdom has little to say about good writing. Its Not Just All About Google Anymore Those webmasters that stick to the old ways and focus entirely on Google are missing out on a lot of search traffic these days if they are not also well ranked by Yahoo and MSN.For the first few months after Yahoo decided to go their own way with natural search (and MSN decided to get serious about the search business), the search results provided by those two could only be described as bizarre. Developing A List Of Keywords For Marketing Keywords aren't just some words that allow search engines, like Google, to find your web site. They are also key elements for creating attractive language to use in your marketing or advertising material. Search Engine Spiders Lost Without Guidance - Post This Sign! The robots.txt file is an exclusion standard required by allweb crawlers/robots to tell them what files and directoriesthat you want them to stay OUT of on your site. ![]() |
home | site map |
© 2006 |