Search Engines and Flash Files

Thursday, July 31st, 2008

In the past, the search engines (Google, Yahoo, Microsoft Live, et all) couldn’t really search Flash files that well. Well Adobe has been working with the search engines to allow them to search the Flash sites, widgets, buttons, and more.

This is good news on the surface, but still requires one digging a little deeper before trying to get a nifty Flash site. Here are three quick take aways to know about, before

The first thing to know, is you still have to use text, as text, to be searchable. Many Flash developers convert the text into something known as shapes so that they can manipulate it easier to look nice on your screen. While your site will look nicer overall, it will cause the search engine to fail to read that part of you Flash site.

Second, most search engines cannot run JavaScript. Because of a software patent issue, Internet Explorer needs JavaScript to write the Flash file to the webpage. So now, in many cases, your Flash site is no longer searchable.

Flash screens, are not the same as web pages, and that means it will be harder to isolate a topic and rank for it, when looking at the overall site with all of the other text working along with it. Add upon that, that most Flash developers are inexperienced at Search Engine Optimization, and lack good tools to build a search optimized site (links, individual pages, helpful page elements, etc) they will most likely not be able to help you rank like a good HTML based website could.

Overall, I would hold off on developing your all Flash based sites if you are interested in long term Search Engine rankings. (Besides, most developers charge more for Flash sites - use that money to make more content which can rank in the search engines, it will be money better spent.)

SEOmoz has more information on his views on why Flash and Search Engines still don’t mix.

Google fills out your search forms

Monday, May 19th, 2008

Occasionally I have found sites that on their home page you would have to select a company or product from a drop down box, and then enter the site from that information. Until now, Google could not access those pages without being provided direct links. Sites with these types of pages were often called the “Deep Web” or the “Invisible Web”, because search engines could not access them. Google has said in the past that they believe that 80% or more of web pages are “hidden” to them because they require a form to fill out to find them.

Now, if you had hired a good Search Engine Optimizer, this would not be an issue as they would know how to provide links to those pages so all search engines could access them appropriately. However, sometimes the advice of your SEO expert is ignored, or you didn’t include one on your team, and thus search engines can’t access those pages.

In April Google announced that it could begin search pages which required a user to fill out a form. This has all types of interesting applications, both good and bad. You need to understand what this means, as well as what this can do. So without further ado, I present The Good, The Bad, and The Truth.

  • The Good:
    • Now more pages will be accessible.
    • Simple “categorical” search forms will no longer cause Google to stumble. For example I recently built a simple movie web application. In it people could search by genre. I had to devise ways to not use a drop down when possible so Search Engines could find the reviews.
  • The Bad:
    • If you tried to “hide” pages, you need to rethink your method. Consider the use of the robot.txt file or robots meta tag to properly ask search engines to not process certain files.
    • Some people fear that this means Google will explore or try to hack restricted access sections of your site. (Remember your robots.txt file in these instances.)
  • Some Truth:
    • Only Google has announced this feature. While other search engines will probably have to follow suite, as this time they don’t and they still account for 35-45% of all search traffic.
    • Only simple forms are filled out. Google is not (currently) entering information into text boxes, so many forms cannot be processed.

More Metrics - Where Your Visitors Come From

Friday, February 8th, 2008

Learning how our web site works is an important task. We’ve seen some simple examples in previous steps (visits, page views, and unique visitors) as well as determining how long someone visited your site, and which was the last page they viewed. We’ve shown how some pages are viewed more than others, and where people exit your web site. We’ve even shown what pages people come to your web site.

What we will look at now is how did they get to your web site. Before they were on your web site, odds are they were somewhere else. Knowing this tidbit of information changes everything, and starts to allow us bring things together.

In the past articles I’ve had a decidedly split view, why this matters, why this doesn’t matter. This is going to be one sided - this matters. And the follow up where your (quality) visitors come from, will matter even more as we show you how the metrics from the previous articles start to fold in with where your visitors come from.

You will get visitors from all over the Internet. Web sites you don’t know about link to you, and such. However, all of these methods/places can be grouped into the following categories.

  • Search Engine (organic) - this is where someone types in a question, and you site was on the list of answers. Depending upon the phrase entered, you may have little (rarely) or lots of competition.
  • Search Engine (paid inclusion/pay-per-click) - You have purchased key words/phrases, and when someone enters a phrase, your ad comes up. That person clicks on the ad, instead of an organic result, you get charged a fee, and they go to your site.
  • Online Ad Network - other networks beside those run from search engines exist, and you have purchased ads to be placed on websites based upon some criteria, and users came to your site from these ads.
  • Another Website - another website, be it a standard site, a blog, a forum, etc. has your.
  • Direct Access/Bookmark - someone typed in your web address or had previously bookmarked your site. This number is often a higher than it should be as sometimes the information used to pass where the visitor came from, isn’t passed. In that case, the Direct Access gets artificially inflated.

The question of course is, why is it this that matters? Here are how we look using the previous metrics to start to determine relevancy, and in how this metric matters.

Lets say you have a small business. And you have a few friends who like to refer their friends to your business. We all know that all referrals are not equal, and someone is going to send you better referrals than others. But how do you know which is which.

Obviously, the one that leads to the most sales is sending you the best referrals. But can you find out why that friend gives you the best referrals? Or better yet why?

You see, search engines, other sites that link to you, and your banner ads are your “friends”. They all want to send you visitors, just some are better at it than others. And just because someone refers a lot of people, doesn’t mean they are sending you the right visitors.

Lets say we look at some on-line ads you are using. You know that you are getting leads from them, sometimes 1000 a day. However, the users leave quickly after viewing the page. If you can segment your viewers and determine that 80% of the visitors that come to your site from this source “bounce” then you know you have a problem you have to address. You don’t know exactly why, maybe the leads/visitors aren’t qualified, or maybe the landing page (the page the visitor sees when clicking on the ad) is ineffective, but now you have something to start looking at to determine what to fix.

On the other hand, you have 1000 people coming from another web site, maybe Google Ad-Words and Yahoo’s pay-per-click. You can see from there that you have a bounce rate of 40%, and they tend to stay for 3 or 4 pages, by then 60-80% of people have left your site. Now we can look at a different set of problems. Could they not find how to buy? Did they get “fatigue” where they got tried of going through the pages? Now we can look at the exit pages, do they move from page to page as expected, or do they bounce around unexpectedly?

As you step through these numbers, I’m sure you will see that not all sources are equal. Some might result in lots of page views, but few conversions (sales, or requests for more information). This is why visitors, page views, and time on site are not necessarily good metrics. You have to learn what type of lead from a source is your best type.

Additionally you can start to segment your search engine data, be it from normal, organic, searches, or from paid search results. Now you can start to see what words and phrases people are using to find you, and how effective you are at converting those people into buyers. This is where your metric data starts to become real important.

Knowing what keywords and key phrases people are using to find your site when dealing with search engines. You might find that the phrases you would use, and you have optimized your site for, are not being used. Is this because there is too much competition, or because consumers use different words than expert/owners. It can also reveal when a phrase is ineffective, because it yields too low a conversion rate.

Knowing how many people repeat visit your site, and/or bookmark you site and directly access it indicates how valuable other’s feel your web site is. Likewise, if you find that most people visit from a given source once, but never return, you can start to see that they don’t place a high value on your site.

You may not be able to determine why people are leaving your site, but you can start to develop some good theories. Just start looking at it from a users point of view, and see what if anything you have to do to enhance your site to increase those conversions.

Watch out for those scams

Monday, January 28th, 2008

From time to time different clients call me up to ask me about something that comes across their desk. Most of the time their gut instinct had it right, and they were looking at a scam.

Sometimes the scam is legal, just immoral - like charging $100 a year for a domain name when it can cost under $10. Or they are charging $200 for submitting your site to Google every month for a year, when in reality, you can do it yourself for free. By the way, over submitting to Google or the other search engines doesn’t help you and can actually hurt you as they see it as a form of spam.

Other times the scam is illegal. I don’t want to post too much just yet, as legal action might be taken, however I wanted to post a couple of links for helping you check out a scam.

www.ic3.gov/ - Internet Fraud Complaint Center
http://www.nethelp.org/scamhelp/ - list of common scams and types of scams
http://www.b4usplashcash.ocba.sa.gov.au/money/scams.html - from the Australian government
http://www.forexscams.org/ - foreign money exchange. This can take many forms, and a variation of this was attempted on my client.
http://www.craigslist.org/about/scams.html - from Craig’s List - a simple easy to follow guide
http://suckerswanted.blogspot.com/ - a list of scams and how to protect yourself

Luckily my client kept her head, realized some of the issues, and when she stepped back to look at the big picture, she saw it as the scam it was, before losing any money. (She did lose about 6 hours of time over a week - and time is money…)

Hopefully the links will be able to help other’s out.

If you know of any resources, please let me know as well.