Real-Time Data And A More Personalized Web

Advertisement

As Web designers, we face a daily struggle to keep pace with advances in technology, new standards and new user expectations. We spend a large part of our working life dipping in and out of recent developments in an attempt to stay both relevant and competitive, and while this is what makes our industry so exciting to be a part of, it often becomes all too easy to get caught up in the finer details. Responsive Web design1, improved semantics2 and rich Web typography3 have all seen their fair share of the limelight over the last year, but two developments in particular mark true milestones in the maturation of the Web: “real-time data” and a more “personalized Web.”

Since the arrival of the new Web, we’ve been enraptured by social media. We share links, we “follow,” we “poke,” we’ve become accustomed to it all. Through no fault of our own, we’ve become lazy users. The likes of Google, Twitter and Netflix cater to our every desire, serving up instant personalized searches, offering recommendations based on behavioral data and tapping into the preferences of our peers and others with similar tastes. Businesses are beginning to realize that loyal visitors can become volunteer sales forces, and these “anti-defection” measures show a real shift in power toward the user.

Web gurus and industry analysts are simultaneously arriving at the same conclusion: we are entering a new chapter in the evolution of the Web. Many would argue that the future of the Web will be influenced by the growth of the mobile market and location services, and their beliefs would be correct. Both of these, however, are pieces of the bigger picture: personalization, instant data and real-time communication. In this article, I’ll explore how the best in the industry are already adapting to these changes and how Web designers can design for an ever-shortening attention span.

Welcome to the new era.

Real-Time Data

Serving up real-time data is an effective way to keep users interested and to persuade them to become return visitors. In large corporations, it shows transparency and accountability and can be a great way to facilitate trust and confidence in your brand.

The rise in browser support for the HTML5 canvas element4 provides the opportunity to display real-time data visualizations without the need for plug-ins—a technique admirably employed by Ben Sekulowicz-Barclay on his portfolio website5 (screenshot below). However, support for the element, and various other HTML5 features for that matter, is relatively limited, as full browser support is not yet here. While canvas can easily display relatively simple data visualizations and animations, it was never intended to replace the likes of Flash and Silverlight, which have more tutorials and learning resources and offer greater interactivity to the user.

When considering the implementation of a real-time data visualization, think of your users. For example, what browsers and devices do they use to view your website? What level of support for JavaScript and Flash are built into those browsers (see Google Analytics6). Also, factor in the complexity of your visualization and the user’s need for interactivity before making your decision.

Tip:
When trying to locate the canvas element on the page, you will need to “Inspect element” instead of viewing the page source. When you choose “Inspect element,” you will see that the document tree after the JavaScript has manipulated the DOM and the tree after the browser has applied its corrections.

Ben Sekulowicz-Barclay portfolio website
7

2010 saw the knives really come out for Flash, and while browser support for canvas is improving, Flash is still a significant force in real-time data delivery. Yes I Am Precious8 documented a charity bike ride across the US, during which the rider’s tweets, location, speed, temperature, humidity, grade and even cadence were all pulled together to form a great front-end experience. The implementation of an interactive history bar across the top of the website, which showed the status of the bike and the rider at various stages of the journey, let the user “roll back” and “replay” events. Consider this important feature when designing for real-time data; it gives context to the content. The emphasis, though, should always be on real time.

It is worth noting that using canvas or Flash for highly complex visualization or a lot of visualization can be taxing on the CPU and will be slower in browsers without hardware acceleration (which are still the majority).

Yes I am Precious9

Stefan Sagmeister’s newly redesigned website offers an interesting alternative: it uses JavaScript to show a real-time feed of his office, with floor-mounted vinyl stickers as the main navigational indicators.

Stefan Sagmeister portfolio website10

Question: What do Google Analytics and printed newspapers have in common?

Answer: They’re both yesterday’s news.

Real-time data is making waves in Web analytics. This new breed of analytics presents owners with instant actionable data and enables them to capitalize on opportunities and mitigate threats.

Chartbeat11 is one of the best examples of real-time analytics around. Its “bells and whistles” interface is backed up by an alert system that, via SMS, email or its very own iPhone app, informs the publisher of traffic spikes and downtime. The interface presents actionable data to the user, highlighted through the “F”-style layout. Color shades are consistent, headers are clear, and changes in data are designed to be easily recognizable. These are all excellent features to include when designing for real-time data.

Chartbeat - real-time Web analytics12

Observing the way users interact with your website in real time is one thing, but acting on your findings is another. One option is to implement a Twitter widget like Monitter13, which doesn’t require a page refresh to update the feed. Monitter uses jQuery to deliver an asynchronous Twitter feed that you can easily implement on your website. It isn’t “real” real-time, but it’s pretty close, and with the surge in popularity of similar services, it won’t be long before truly real-time APIs and widgets are available. This use of a real-time Twitter widget allows publishers to communicate rapidly with their users and show what people are saying about their product or service.

Monitter - real-time Twitter.14

For the last two years, Collecta15 has provided a real-time search engine, offering free embeddable APIs and publisher widgets. However, Collecta has recently stated that it is shuttering its main product and is now looking in a new direction in the real-time data market. When asked about their reasons for switching direction, CEO Gerry Campbell spoke about what he learned from their two years in business:

“First, there is a huge need for real-time information, Second, a destination site is not the correct vehicle for reaching people. Third, new behaviors, specifically with Facebook and mobile, are growing.”

— Gerry Campbell, Collecta

Interestingly, Collecta’s main competitor, OneRiot16, has also recently changed directions, shelving its search engine and moving into online advertisements.

This highlights an important point for the API consumer: always have a back-up plan in case your API provider pulls the plug (as Collecta and OneRiot have done).

Collecta - real-time information.17

Another proclaimed casualty of last year was the RSS feed, partly due to Twitter’s new-found purpose as a news distribution service. However, many believe that RSS is evolving to meet rising user expectations in the new Web climate. PubSubHubbub18, in addition to being quite a mouthful, is an instant publishing and subscription protocol that adds real-time capabilities to your RSS feed. PushPress19 is a particularly useful plug-in that adds PubSubHubbub support to your WordPress RSS feed and allows your push subscribers to receive updates instantly.

One of the main advantages of PubSubHubbub is that it “pushes” new content to your users without the need for crawlers to “poll” (i.e. regularly visit to check for new content) your feed, thus saving CPU and bandwidth. While services such as Ping-O-Matic20 provide a similar service, subscribers still need visit the URL, which is where PubSubHubbub shines because it requires your server to do less work.

PushPress - Add PubSubHubbub support to your WordPress website21

It is important to recognize that the successful delivery of real-time data relies heavily on the integrity of the data. While vetting and backing up data are sound practices for any publisher (real time or not), serving up data in real time increases the importance of their adoption. The need to curate and filter data is also important when considering your website’s performance. When delivering real-time data, you want to keep client-side processing to a minimum and do whatever processing you can on your server. This way, you are only sending the user data that is useful to them, and you are optimizing the speed of your website.

On smaller shared servers, you will need to keep the volume of data small to adhere to bandwidth limits and ensure that your server isn’t spending too much time processing data in order to save CPU. If this limits your options, you could always upgrade your hosting package or use a third-party service such as Kwwika22, which will keep processing off your server.

A More Personalized Web

Every two days, we create as much information as we did up to 2003.

– Eric Schmidt, then-CEO of Google

Although there are many positives to the rapid growth of user-generated content over the last few years, there are of course some corollary effects of the “content tiger.” Users are quickly becoming overwhelmed by the sheer volume of information being presented to them, with the increase in real-time data further weakening the “signal-to-noise” ratio. In an attempt to alleviate these problems and better organize the mass of information and data available, developers and content providers of the future will thrive by making relevant information find the user, as opposed to the user having to find the information relevant to them (bringing the mountain to Mohammad).

While catering to unique visitor segments and personalizing user experience is nothing new, its relevance has never been more important, and the technologies available to us have never been better. As the user becomes even more accustomed to these personalized touches, the bar of user expectation will once again rise, leaving behind sluggish publishers and retailers that are slow to adapt their online strategy.

Not only is this further shift towards a more personalized user experience becoming a necessity for our bombarded user, it also demonstrates, more interestingly, a measurable shift in consumer behavior. I presume that most of you will get your hair cut a few times this year. How many of you go to a particular salon or barber shop? How many of you even have a preferred hairdresser at that location? I know I do, and I return to this particular hairdresser month after month not for the complimentary light literature and cup of coffee, nor even for the quality of the haircut. I return because the service is personalized—a concept lost on some businesses.

Instead of looking after existing clientele, these businesses choose to put all their resources into pursuing new business. The method of targeting individual users based on their profile histories and the profiles of others has been fervently exploited by the e-commerce market. Savvy companies realize that traditional marketing and advertising methods no longer exclusively drive consumer behavior, and they are instead turning their attention to personalizing their services and investing in word of mouth. These companies are giving users both the inspiration and tools to talk about their products and share them across various social networks. Seth Godin coined a term for this process: flipping the funnel.23

Netflix24 was one of the first to implement a recommendations engine on its website. In addition to recommendations, there’s a “Friends” tab where the user can see what their friends are watching in order to compare interests. Recommendation engines use specific types of information filtering to present items (movies, products, etc.) that are likely to interest the user. When implementing such a mechanism, you must first understand the data, content and user’s intent. Recommended results should be visually defined and supplemented with a clear marketing message, and you should always be aware of data-shift issues. Although this type of technology may seem out of reach to small businesses and their developers, it is still possible on a smaller budget.

Programming Collective Intelligence25 is probably a good staring point for anyone looking to implement such functionality.

Netflix - Watch TV Shows Online, Watch Movies Online26

In June of last year, Facebook CEO Mark Zuckerberg commented at London’s Barbican Centre on the potential of “products built around people” and spoke of the company’s “aggressive expansion” into the “personal Web.” Facebook’s “Connect” APIs allow websites to connect with a Facebook user’s identity, profile information and even information about the user’s friends. These APIs provide an alternative to the sign-up process, social context, personalized content and other means of customer service communication.

Allowing users to share content across a variety of social platforms is an effective way to reach a large targeted audience. Social “sign-ins,” commenting, content sharing, widgets and APIs are all effective methods of optimization. Social optimization is beginning to rival search engine optimization in importance in the world of online marketing. A recent survey by Pew27 found that 75% of news consumed online was via links on social networking websites or in email.

Facebook Connect28

The new BBC29 website is one of my favorite examples of a personalized user experience. The user can drag and drop various news widgets around the home page, remove them completely or customize the content that each widget serves. The website is optimized for social networks, but I feel that the sharing utilities could be slightly more user-friendly. Another step some companies have taken is to re-arrange content and navigation based on user profiles. While this can be convenient for the user, it can also put them off and have a negative effect on usability. For this type of personalization to work effectively, publishers should ensure that they build comprehensive customer profiles before creating rules to target user preferences.

BBC home page30

Reviews and comments are another way to engage and empower visitors. If your business delivers a good product or service, then they allow users to share their reviews over numerous social platforms. It’s the perfect breeding ground for customer evangelism.

Trip advisor31

In addition to optimizing your website for mobile use or creating an app, personalize your service by targeting users according to their location. Recently, Google’s Marissa Mayer told Media Bistro32 that Google’s focus at the local level is to use location to help searchers find what they’re looking for. Google’s interest in the local market led to an attempted acquisition of Groupon33, a discount provider that has been particularly successful in targeting users by location and socially optimizing its services.

Find Great Deals on Fun Things to Do34

Summary

While this cataclysmic shift in the evolution of the Web and the role of the user is welcomed by most, others argue that focusing on providing a personalized Web experience creates an echo chamber of information, opinions and ideas. Is the outsider’s perspective getting lost? Are user expectations of “real time” becoming unrealistic? And could pandering to these expectations contribute to our own downfall? Regardless of the continuing importance of a static Web presence and the infancy of these new technologies, serving up the same stale content to everyone is, without question, no longer enough.

Other Resources

Real-Time Data:

A Personalized Web:

Related Articles

You might want to read the following related articles as well:

(al)

Footnotes

  1. 1 http://www.alistapart.com/articles/responsive-web-design/
  2. 2 http://www.smashingmagazine.com/2010/09/23/html5-the-facts-and-the-myths/
  3. 3 http://www.smashingmagazine.com/2011/03/02/the-font-face-rule-revisited-and-useful-tricks/
  4. 4 http://www.whatwg.org/specs/web-apps/current-work/multipage/the-canvas-element.html
  5. 5 http://www.beseku.com/
  6. 6 http://www.google.com/analytics
  7. 7 http://www.beseku.com/
  8. 8 http://yesiamprecious.com/
  9. 9 http://www.yesiamprecious.com/
  10. 10 http://www.sagmeister.com/
  11. 11 http://chartbeat.com/
  12. 12 http://chartbeat.com/
  13. 13 http://monitter.com
  14. 14 http://monitter.com/
  15. 15 http://collecta.com/
  16. 16 http://http://www.oneriot.com
  17. 17 http://collecta.com/
  18. 18 http://pubsubhubbub.appspot.com/
  19. 19 http://wordpress.org/extend/plugins/pushpress/
  20. 20 http://pingomatic.com/
  21. 21 http://wordpress.org/extend/plugins/pushpress/
  22. 22 http://kwwika.com/
  23. 23 http://sethgodin.typepad.com/seths_blog/2006/01/flipping_the_fu.html
  24. 24 http://www.netflix.com/
  25. 25 http://rads.stackoverflow.com/amzn/click/0596529325
  26. 26 http://www.netflix.com/
  27. 27 http://pewresearch.org/pubs/1508/internet-cell-phone-users-news-social-experience
  28. 28 http://developers.facebook.com/docs/coreconcepts/
  29. 29 http://www.bbc.co.uk
  30. 30 http://www.bbc.com/
  31. 31 http://www.tripadvisor.com/
  32. 32 http://www.mediabistro.com
  33. 33 http://www.groupon.com
  34. 34 http://www.groupon.com/
  35. 35 http://ria.dzone.com/articles/flex-data-visualization
  36. 36 http://www.patrick-wied.at/static/heatmap/
  37. 37 http://www.filamentgroup.com/lab/update_to_jquery_visualize_accessible_charts_with_html5_from_designing_with/
  38. 38 http://www.web2expo.com/webexny2010/public/schedule/detail/15668
  39. 39 http://www.linux.com/learn/tutorials/382878:weekend-project-add-pubsubhubbub-syndication-to-your-site-or-blog
  40. 40 http://www.leggetter.co.uk/
  41. 41 http://mobile.tutsplus.com/tutorials/mobile-web-apps/html5-geolocation/
  42. 42 http://womma.org/word/
  43. 43 http://womma.org/word/2010/09/08/social-algorithms-personalized-web/
  44. 44 http://www.1stwebdesigner.com/tutorials/facebook-integrate/
  45. 45 http://gigaom.com/cloud/5-predictions-for-apis-in-2011/
  46. 46 http://info.gigya.com/WP.FBES.html
  47. 47 http://www.smashingmagazine.com/2011/03/29/designing-for-the-future-web/
  48. 48 http://www.smashingmagazine.com/2010/04/10/holistic-web-browsing-4-trends-of-the-future/

↑ Back to topShare on Twitter

Sam Quayle is Graphic designer/ Front-end developer / Gooner working for Erskine in the lace city, Nottingham, UK. You can view his personal site 'Pelican Fly' Here.

Advertising

Note: Our rating-system has caused errors, so it's disabled at the moment. It will be back the moment the problem has been resolved. We're very sorry. Happy Holidays!

  1. 1

    The best thing to do is not to pay attention to all those new “trends”

    I even think the very best designers and developers realy don’t or even try to follow every little blog post about supposedly new trends.

    Maybe it’s because of the people who don’t follow every little trend, we get new trends!

    Just think about what the user wants, and what the app or site needs to accomplish. A lot of times things go the other way arround > “We can do this new cool thing so let’s think of something to put it in use” ; and that’s how the web gets bored with tons sites with the same things. Everyone wants to follow trends BECAUSE it’s a trend.

    Oh my god i’m so glad the whole web 2.0 bullsh*t is behind us. That was the worst thing happened to the web and you know why? Because some designer thought web 2.0 was all about putting stupid glossy effects on every single little thing in a design; it made me wanna cry :)

    but, the post is nice, nice roundup and nice explanation and examples of the realtime en personalized web

    • 2

      I understand your meaning of trend , but i think i was more of a showcase on new web technologies and EXAMPLES of how it could be implemented into your site. It’s not telling you to follow these exact guidelines. Take that technology and try to find a new way to use it as a unique an reliable source.
      If a person doesnt appreciate the development of technology in webdesign, then that person i s in the wrong business, because its always changing.

      • 3

        “take that technology and try to find a new way to use it…” is exactly the thing i tried to point out: this way it is used from the technology point of view, wich in my opinion is precisely the wrong way.

        I mean dont get me wrong, all those new possibilities are realy great and you indeed need to keep yourself updated

  2. 4

    With all the talk about canvas, I would’ve expected at least a little notion on (the lack of) accessibility that comes with it.

    As for personalized suggestions and other semi-random crap, I see those purely as nonfunctional ads that will only cater to those with very unspecific taste. My usual response to those widgets is “why the hell would you ever recommend that to me?”.

  3. 5

    Great article – very interesting ideas for personalisation of pages.

    For real-time analytics there’s a number of options out there including our own tool, GoSquared, that some of you may have seen on Smashing Mag before:

    http://www.gosquared.com/

  4. 6

    I believe Netflix dropped their Friends functionality 6 months ago. They removed the tab, moving it into the footer before removing it altogether near the end of last year.

    • 7

      Hi Andrew,

      Thanks for your comment, that is an oversight on my part. I started writing the article a little while ago and didn’t notice that Netflix had dropped the functionality.

      • 8

        BBC website has also changed in the last two weeks, no more drag and drop! I do not like the new layout – especially the accordion at the bottom – but I do think that the drag and drop is best left to sites like http://www.geckoboard.com/

  5. 9

    I’ve been most impressed by Clicky, http://getclicky.com. I’m a web developer and I also teach and Google Analytics is often too much for clients or students to fully use – the learning curve is too steep. I tried out clicky recently and I’m hooked – I’ll be recommending it to clients and students as a much better alternative to GA.

    • 10

      What type of information are you getting out of real time data that you can take action on and feel very confident in those actions?

  6. 11

    yeah , first coming , good article!

  7. 12

    good article for all designers and me

  8. 13

    Bratu Sebastian

    April 30, 2011 5:15 pm

    Great article. We really need to pay attention to the analitics out there, it seems that the whole internet it going to twitter-like functionality :)

    Interesting post.

  9. 14

    There was a research which says every minute 2000+ websites are integrated with Facebook. The web is changing everyday and the bubble of 2001 is long forgotten now. The possibilities have increased many fold.

  10. 15

    Agree and I definitevly think that Personalized web and Reccomendation systems are going to be the next Big Thing in the web industry:

  11. 16

    I am curious about what folks would consider is actionable data out of real time analytics. My company is currently evaluating Chartbeat but I am having trouble understanding how it can be used outside of publishing. Thoughts?

  12. 17

    official cheap tory burch sale

    August 25, 2011 2:37 am

    The wide width dress sandals from Softspots are extremely popular because of the high level of comfort they offer while retaining the style element.

  13. 18

    Real time data is very important, imho. I would want to use a desktop camera to record behavour of my visitors :) That would be awesome, right? :)

    But it’s going to be the next big thing on the internet, as Matteo said.

  14. 19

    It’s interesting as the web used to be very generic and now with personalized features it’s becoming more tailored to each person as it and big companies like Google learn more about the person, the downside is that it means people probably won’t explore and find new stuff, the good side it items you see are more relevant, this is also seen in ecommerce trends sites like http://www.personalise.co.uk have adopted an approach similar that means you don’t just buy generic stuff online either anymore. It all makes for an interesting future in how personalized the web can be before it starts being detrimental to us all.

↑ Back to top