Omniture Form Analysis Pitfalls – How to Avoid and Optimize

There is an Omniture plugin, Form Analysis, that will automatically flag which form field a user last touched before abandoning a form. Sounds great, right? This post, which does a great job of going over setting up the plugin, even claims the plugin will make you an office hero! The problem is, this plugin is inherently Evil. And not the good kind of evil. We’d like to tell you how to avoid the evil and keep your Form Analysis on the side of Good.

This plugin is notorious for being implemented incorrectly, and the implications go beyond just one report not working. Since the plugin sends a custom link call (s.tl()) each time a user abandons a form, it has the potential to eat up your secondary server calls (which you pay Omniture for). A recent client of mine has accidentally set one extra secondary server call on every single page view since 2008 because of this plugin. Sending two server calls (one with the click of a link and one on the load of the next page) so close together has been known to cause problems- every once in a while, the two calls compete and only one makes it through to Omniture, decreasing data accuracy. Worst case scenario, the plugin can actually break your form.

And what bugs me most- and this is in no way the fault of the plugin- is that folks use this as a safety crutch: they know they should optimize forms, so they put effort into setting up form tracking, then pat themselves on the back for  job well done. But, feeling comfortable that the data is there, they don’t take it to the next step and actually optimize their forms.

In this situation, you’d be better off skipping the plugin and go right to the “optimize your form” step by using your God-given intelligence. Use common sense. Think like a user: keep forms simple and easy to use. Simply running a plugin or tool will do nothing to improve your forms- remember, brains are more important than tools.

Don’t get me wrong, the plugin has much potential to do good. You just have to put some thought into it. Educate yourself on using this plugin and you can get great value out of it. To help you, here are some implementation pitfalls to avoid:

1. Potential Problem: Tracking the wrong forms

The configuration of the plugin includes two critical variables:

s.formList=”"
s.trackFormList=false

When trackFormList is set to true, it will only track forms specified (using the form’s HTML “name” attribute) in the formList (if formList is blank, then nothing will be tracked). So far so good. When set to false, the plugin will track every form on your site that is NOT specified in the formList. This includes:

  • User login forms (even if they are on every page)
  • Some asp.net “forms” that are not actually user forms
  • Find-a-location-near-you and other single-field forms
  • CAPCHAs
  • And, the biggest culprit: Internal Search forms

So if a user hits a page with an internal search form field without hitting the search “submit” button, that’s one server call to Omniture letting you know a “form” was abandoned. If each page has that internal search field, that’s one server call for every page view on your site. Not only is that information useless to you, it has potentially terrifying billing implications, depending on your contract.

Solution: s.trackFormList=”true”

My suggestion? ALWAYS have trackFormList equal to “true”. This will require you going through your site and finding the forms that matter most. Focus on one or two key forms on your site. This isn’t just a work-around to get the plugin to work- it’s a great idea for focusing your analysis efforts and avoiding the Data Squirrel pitfall.

2. Potential Problem: The Plugin relies on your forms being set up “just right”

If you do not have the “name” attribute in the HTML <form> tag, the plugin won’t work. And if you do have names but they look like “form134″, it probably won’t have much meaning for you in the reports. And if every form on your site has the same name, the report will be useless. Same goes for form field/input names.
On another note, if your form script references the “this” object at all, the plugin may break your form, or vice versa. Oops. The only way around it is to remove the plugin, or remove the references to “this”.

Solution: Update form html

I’m afraid there is no quick javascript fix here: if you want to automate form abandonment tracking using this plugin, you may have to manually change the “name” attribute of the HTML forms. BUT, if you are focusing on only your 1-2 key forms, as mentioned above, the changes to your HTML should be minimal.

3. Potential Problem: Can paint inaccurate picture of which field is “guiltiest”

The plugin doesn’t tell you which field was the “turn-off”: it tells you the last field touched, which may be counter-intuitive. For example, on the right is what my form looked like when the user abandoned:

Our friend Mal only made it through the 4th field- the one with the name “email”. The plugin would report this as:

pageName:formName:email:abandon

Which might make one think the “email” field was to blame for the abandon, when in truth, he filled out that field successfully and was (presumably) “turned off” by the FOLLOWING field, asking for him to confirm his email- he’s much too busy to waste time by entering the same information twice.

Solution

One can get around this by 1)educating users of the report on what the data means (which you should be doing anyways) and/or 2) creating a classification report that says the FOLLOWING field for each item. Either way, please be aware that a report can only give hints- it cannot actually tell you what the user was thinking when they left the form or if they had looked ahead further in the form and were “turned off” by a later field.

Which brings us back to the idea that your brain is a critical part of making this plugin valuable. If you have a form on your site, now is a great time to optimize it. We’ve removed the roadblocks; what’s stopping you?

10 thoughts on “Omniture Form Analysis Pitfalls – How to Avoid and Optimize

  1. Jenn – this is great stuff!! I inherited an implementation and am bit by bit correcting and enhancing some of the challenges that existed – problem #1 exists on our site and your article clearly articulated the issue and the solution!!. Thank you!!

  2. Thanks for this post – it’s somewhat timely as I’m in the process of tweaking a form analysis implementation. Thankfully we only have couple of guys who will use this report, so the education part is relatively easy. The idea of using a classification to further reinforce the notion that it could have been the *next* field is brilliant. I think I might use that one :)

    • I’d love to take credit for the classification idea, but it originated with Adam Greco. I do think it’s a great idea- on top of allowing for more accurate analysis, it could also make the report a bit friendlier to look at. Let us know how it works out, we’d love to hear feedback!

  3. Pingback: Enhancement to SiteCatalyst Form Abandonment Plug-in and Reporting to improve its usage in 2 Stage

  4. Thanks Jenn – helpful post.

    I’m curious if you have a form analytics tool that you’d suggest over Omniture’s plug-in. I’m currently looking for the best solution to help understand how users are interacting with our various magazine subscription order forms. We have omniture implemented but haven’t used this plug-in yet and it frankly sounds like a headache with limited benefits. I’ve been impressed with what I’ve read on Clicktale’s form analytics reports so I’m leaning in that direction – any pitfalls there that you know of? Any other tools I should consider? Thanks in advance.

    • I do think using the Form Analysis plugin can be a good start (just beware all the pitfalls and it can be a decent tool), and it is handy to have that information in there with all of your analytics conversion info. That said, there are a lot of good usability testing tools out there.
      I have heard nothing but great things about clicktales- and there is a chance you could get a lot of the data you need within a 30-day free trial. http://www.seevolution.com/ has a pretty good tool (though not as form-specific as clicktale’s form analytics), as well, and is the most affordable option I know of.
      One more SiteCatalyst option to consider is to A/B test your forms. Do some iterative tests to see what combination of fields lead to the highest conversion. This could be done in Test&Target (or even google’s free website optimizer), but also in just SiteCatalyst using one eVar to identify which “form version” a user is on.

      Good luck!

    • I usually have s.usecommerce set to false, so you get data on abandons to just one prop. You can see the number of times each field was abandoned.
      Setting it to true gives you the option of using an eVar for the form field, and events as metrics not just for an abandon, but also for a successful submission or an error, though I dislike using that option- seems a bit overkill. In truth the plugin doesn’t much simplify the tracking of a success or an error. Either with or without the plugin, if you want to track errors, you will need to add code to your error handling; if you want to track successes, I recommend setting a success event on the page the load after the form is submitted.
      Hope that helps!

Leave a Reply

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>