Our Blog

What we post and publish is awesome!

Digital Marketing Tips On Getting Your Web Site Crawled Quickly

Digital Marketing Tips On Getting Your Web Site Crawled Quickly

digital marketing huntington beach serp rankings

merakist / Unsplash

The world of digital marketing is a highly competitive place. As a beginning digital marketer there are some basic things you should know about how search engines spiders and index your website. Unless the search engines find your website and index it, there is no way the general public will know that it is there.

After you have created your web site and chosen the products or services you want to provide, you will be ready to get your site listed with the search engines. When developing your marketing strategy, it is important to include a plan to get your web site spidered quickly.

In order to get your site indexed you must let the search engine spiders know you are there in the first place.

You may have wondered if there are ways to lure the Google and Yahoo spiders to your web site other than manual submission. The good news is that many SEOs recommend the following methods rather than submitting your pages directly.

The best way to get your site spidered quickly is to link your web site to another site that is already indexed, that is related to your site, and that is spidered frequently. Having your site mentioned in news releases, blogs, and so on can get your site your web site spidered very quickly, sometimes within days.

You can also use the more traditional methods including posting in forums and providing articles for the various article directories. If you choose this route, be careful not to spam. Follow the posted rules, give helpful answers, and do not go overboard on your “sig file”. Private forums are not always indexed, so make certain that the forums where you post display recent posts and are listed in search results.

No matter which method you choose to get your web site spidered, you will need a good site map. A site map lists and links to all pages on your site. If your site consists of over approximately one hundred pages, consider using a multi-page site map. Make certain that every site map page links to all other site map pages. You should have a link to your site map on your home page and preferably on each of your pages. You should make sure your web site pages are simple and free of useless clutter.

Getting your web site spidered quickly is the most important thing you can do to achieve success as an internet marketer. Using the methods suggested above can be very helpful in getting your web site indexed.

Getting indexed in Yahoo has become very difficult in the last few months. The indexing robot, Yahoo!Slurp, has become erratic. For some sites, the robot will view all pages, but only add a few to the Yahoo database. For other sites, sub-domain listings actually start disappearing! So, what?s the secret to getting indexed?

Pleasing Yahoo!   Slurp

The secret to getting indexed in Yahoo involves constant updates to your site. The updates, however, have to be done on both the site and through Real Simple Syndication (RSS) feeds. Here’s how you go about getting indexed.

The first step is to start a blog for your site. You can build a blog on your site or use a free service. I prefer blogger.com because it is easy to use, but you can use whatever you like. Once you have your blog up, you should make entries that correspond and link to content on your site. For example, I will post this article on my blog, Moshing Search Engines, and link it to the article page on numerous social platforms.

To supercharge the impact of the blog, you should also link to a site map on your site. If you do not have a site map, make one in HTML or get a WP sitemap plugin. The Yahoo robot will definitely follow it and index the pages. Don’t rely on the xml site map strategy Google is promoting for Yahoo ranking.

Once you have the blog up with content posted, you must turn the blog into a real simple syndication feed. Again, you can use your own system. I prefer to use a free service because I really don?t have the time to waste on such things.

Feedburner.com seems to work find and is simple to use. Opening an account with Feedburner is so easy, I am not even going to explain it. At the end of the process, feedburner will kick out the link for your RSS feed. Here?s where the magic begins.

If you have a yahoo email account, you need to access you?re My Yahoo page. If you don?t have an account, get one! Once you are on the My Yahoo page, do the following:

1. Click the add content link in the upper left hand under the search box.

2. When the new page opens, click the Add RSS by URL link on the right of the Find Content search box in the upper section of the page.

3. Enter the exact link provided by Feedburner and click ADD. Do NOT add the url for your blog.

4. Click the My Yahoo tab at the top of the page and refresh the page.

At this point, you should see your feed at the bottom of the page. If you don’t, be patient. Yahoo is sometimes slow, so just try it again in an hour or so. When the feed is added, you should see the name of your blog and the title of each post under it. Yahoo can take up to a day to add new posts, so do not panic if they do not show up immediately.

Once you have completed the above, Yahoo will follow the links in the blog and index the pages on your site. If one of the links goes to a site map, you are in business. As an added bonus, Google will do the same thing. Let?s look at an example.

We are currently building thebrooklynnomad.com, which has been up for about 6 months. Roughly 10 to 20 pages are being added each day. The blog for the site and the feed is included on four My Yahoo pages for various email accounts. Recently Yahoo has indexed 95 pages and is about four days behind the page additions. Google has indexed 151 pages and is adding to the index every day. The blog and RSS feed are solely responsible for getting these pages indexed this quickly.

Depending on the size of your site, the process can take a few days or a couple of weeks. Every time you add new content, slap it into your blog with links. In no time, you will be taming Yahoo!Slurp.

Digital Papercuts

5904 Warner Ave, Ste -2011, Huntington Beach, CA 92649

Phone (800) 451-7085

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Digital Papercuts

Don't be shy, get in touch with us

5904 Warner Rd Ste A-2011 Huntington Beach, CA 92649