The Insider's Guide to Next-Generation BPM
By Gary Orenstein, Vice President, Technical Solutions, MaxiScale , 10/06/2009
Print this article
Email this article
Talk Back!
Write to Editor
Photo sharing has become one of the most popular Internet applications with sites such as Flickr, Shutterfly and SmugMug making it a "snap" to upload and share pictures. Millions of people now access and post billions of photos every day. Facebook, for example, reports that its users upload more than 10 billion photos each month.
But photo sharing is working its way to other sites for recommendations, e-commerce product reviews, and user contributed news. So the challenge of handling an ever-increasing number of photos now applies to a larger range of web properties.
To support the unpredictable yet ever-increasing number of uploads and views, photo hosting applications generate various sizes, like thumbnails and previews to speed the process. Add this burden to the lack of control over content uploading, and the underlying infrastructure is severely taxed. It has to store and retain multiple sizes for each photo while also serving millions to billions of photo files to a worldwide audience.
For web companies on the rise, preparing for this data growth can be challenging. Innovative architectures are imperative to ensure peak performance as old systems and approaches simply cannot handle the workloads. New, distributed systems and optimized small-file serving resolve these challenges for any web property relying on photos to enrich their application.
Storage challenges and solutions for large scale photo sharing
Let's take a closer look at a few of the key challenges and potential solutions to building and scaling large photo sharing applications.
Managing small files (and lots of them)
The sheer number of contributed photos multiplied by the different sizes kept on hand quickly mushrooms into a small file handling mess. Many file systems and storage architectures developed just a few years ago are not capable of managing small files efficiently.
Two major trouble sources are the delay in scanning a directory with many files, or the time it takes to sort through many directory levels. When trying to retrieve a jpg preview, these taxing operations create system delays. Traditional systems also tried to brute force the small file approach by using many small, fast drives, RAID striping, and memory over-provisioning but this quickly leads to excessive hardware costs.
-1-
Best Practices in Moving Processes to the Clouds
How Can the Cloud Fit Into Your Applications Strategy?
Cloud Data Integration Best Practices
The Economics of Cloud Computing
Data Services Insight: Successful implementation of Canonical Information Models
Measuring the ROI from web experience management 
Top 10 Reasons to Replace Enterprise Search with Unified Information Access Part 2
Top 10 Reasons to Replace Enterprise Search with Unified Information Access Part 1
Exits and Acquisitions: Key Concepts for Successful Deals
Cloud Computing: Why we Need to go Back to the Future
Increasing Annuity Sales Through the Implementation of Industry Standards
ebizQ editorial highlights and updates, compiled by Site Editor Anne Stuart
March 10, 2011
The sixth annual BPM in Action 2011 Virtual Conference will explore cutting-edge market developments in BPM and describe how to leverage them for improved business operation and performance. More
Date:Apr 07, 2010
Time:13:00 PM
ET- (17:00 GMT)
Date:Apr 07, 2010
Time:12:00 PM
ET- (16:00 GMT)
In part two of Joe McKendrick's recent podcast with Miko Matsumura, chief strategist for Software AG, they talk about how SOA and IT systems need to change and grow and adapt with the organization around it.
Listen Now
Phil Wainewright interviews David Vap, VP of products at RightNow Technologies, and finds out how sharing best practices can help businesses understand how best to engage with online communities.
Listen Now
Scott Hebner, Vice President of Marketing and Strategy for IBM Rational, discusses a topic on the top of every company's mind today: getting the most from IT investments.
Listen Now
In BI, this tough economy and the increasing role of Web 2.0 and MDM are certainly topics on people's minds today. WiseAnalytics' Lyndsay Wise addresses each of them in this informative podcast.
Listen Now
Deepak Singh, President and CTO of Adeptia, joins ebizQ's Dennis Byron in a podcast that gets its hand around the trend of industry-specific BPM.
Listen NowSmart event processing can help your company run smarter and faster. This comprehensive guide helps you research the basics of complex event processing (CEP) and learn how to get started on the right foot with your CEP project using EDA, RFID, SOA, SCADA and other relevant technologies. Learn More
A lot of people are talking about Enterprise 2.0 as being the business application of Web 2.0 technology. However, there's still some debate on exactly what this technology entails, how it applies to today's business models, and which components bring true value. Some use the term Enterprise 2.0 exclusively to describe the use of social networking technologies in the enterprise, while others use it to describe a web economy platform, or the technological framework behind such a platform. Still others say that Enterprise 2.0 is all of these things. Learn More
|
|
This new publication from our sister site SearchSOA.com explores workflow, business activity monitoring (BAM) and complex event processing (CEP) issues. |
|
|
