9:05 AM PDT We are currently experiencing elevated error rates with S3. We are investigating.
9:26 AM PDT We’re investigating an issue affecting requests. We’ll continue to post updates here.
9:48 AM PDT Just wanted to provide an update that we are currently pursuing several paths of corrective action.
10:12 AM PDT We are continuing to pursue corrective action.
10:32 AM PDT A quick update that we believe this is an issue with the communication between several Amazon S3 internal components. We do not have an ETA at this time but will continue to keep you updated.
11:01 AM PDT We’re currently in the process of testing a potential solution.
11:22 AM PDT Testing is still in progress. We’re working very hard to restore service to our customers.
11:45 AM PDT We are still in the process of testing a series of configuration changes aimed at bringing the service back online.
12:05 PM PDT We have now restored communication between a small subset of hosts. We are working on restoring internal communication across the rest of the fleet. Once communication is fully restored, then we will work to restore request processing.
12:25 PM PDT We have restored communication between additional hosts and are continuing this work across the rest of the fleet. Thank you for your continued patience.
12:51 PM PDT The restored hosts are stable and we are moving forward in restoring communication between additional hosts.
1:17 PM PDT We continue to make incremental progress and communication between additional hosts has been restored. We are continuing with the plan to restore communication across Amazon S3′s large fleet of hosts.
1:38 PM PDT At this point, we are accelerating progress on restoring internal communication as all signs continue to look good.
2:03 PM PDT We have restored all internal communication between hosts in the EU and we are continuing to make progress in the US. Once all internal communication has been restored, we will start a multi-step process to begin accepting requests across Amazon S3 locations.
2:19 PM PDT A quick update to let you know that we have now also restored all internal communication between hosts in our West Coast facilities in the US.
2:36 PM PDT We have restored all internal communication across Amazon S3 hosts. We have started the multi-step process to begin accepting requests across Amazon S3 locations.
3:07 PM PDT We are attempting to bring EU back up now, followed by our US locations. EU will be first due to the smaller number of hosts. No data has been lost during this incident.

Other DeepMarket Articles

• No Good Deed is Left Unpunished
• United Service Organizations
• Home Repair Expense is an Investment
• Inauguration Room Rental – is it worth the effort?
• DeepMarket is Back!

Recommended by DeepMarket

• Google is the Past – Twitter is the Current – Lead generation to adjust  (LEADS Explorer)
• Email marketing is not a sustainable model  (LEADS Explorer)
• Twitter Is Down, Company Acknowledges System Issues  (F.A.E.M.M.)
• Sales is a Simple Process  (Sustainable Revenues)
• Launching a product is one – getting to use it is another thing  (LEADS Explorer)

Ask Deep Market To Recommend Your Posts

So, how does anyone compete with this horsepower? Obviously, Microsoft and Yahoo can afford to work in the same way. Well, LookSmart back in the day had something that could approach the horsepower of the Google back-end. Their secret weapon was Grub – a distributed web crawler:

People who choose to download and run the client will assist in building the Web’s largest, most accurate database of URLs. This database will be used to improve existing search engines’ results by increasing the frequency at which sites are crawled and indexed.

One day a couple of years ago, LookSmart just closed Grub down. However, yesterday it was announced that the Grub project had been sold to Wikia. WikiaSearch plans on using Grub to help create an open source search engine:

Transparency – Openness in how the systems and algorithms operate, both in the form of open source licenses and open content + APIs.
Community – Everyone is able to contribute in some way (as individuals or entire organizations), strong social and community focus.
Quality – Significantly improve the relevancy and accuracy of search results and the searching experience.
Privacy – Must be protected, do not store or transmit any identifying data.

Well, I certainly wish them good luck and I plan on trying the Grub client. However, it looks like the client isn’t fully functional at this time.

Other DeepMarket Articles

• CNBC Million Dollar Portfolio Contest is Back
• The Physics of the Markets
• There is Inflation – then there is Inflation
• DeepMarket is Back!
• Grub – data flowing

Recommended by DeepMarket

• Google is the Past – Twitter is the Current – Lead generation to adjust  (LEADS Explorer)
• Where The Heart Is  (Beautiful Sin Webmaster Resources)
• The salesman is left in the cold  (LEADS Explorer)
• Excellence is in the detail.  (webdesign)
• Take back the economy  (PamSlim)

Ask Deep Market To Recommend Your Posts

A popular example is SETI@home. SETI is the Search for Extra-Terrestrial Intelligence, which is looking at radio telescope data for signs of intelligent life beyond our planet. Radio telescopes produce a bunch of data and crunching through these signals looking for indicators of ET would take any one computer (even the most powerful supercomputers) hundreds of years to process. So, you break the problem into smaller pieces and distribute these pieces to thousands of computers for them to solve and report back their answers to a central server. Instant raw processing power!

So, how are people using distributed computing for the stock market? Well, at least one public project, MoneyBee, is trying to leverage distributed computing to tackle the stock market. They have a screen saver that you can download and it will use your computer when it is idle to process jobs. These jobs are training neural networks to predict the movements of individual stocks and indexes. Okay, so I am not a big fan of neural networks, but we will have the PRO and CON debate about them in the future. The point here is MoneyBee is gathering large amounts of processing power and focusing it on a problem -> predicting individual stock movements. Not many other public projects out there, although Intelligent Broker appeared a couple years ago (and is now gone – this link points to an archive in archive.org), but never really seemed to do anything. It seems the concept was to have an open platform for developers to use the processing power of 100′s of machines to create stock market related trading systems that could then be sold to traders interested in the systems. A cool idea, but it seems to be dead now.

So, think about distributed computing when you happen upon a problem that requires a good amount of processing power to solve. There are plenty of distributed computing platforms that allow you to develop applications to take advantage. Another great resource that lists other public non-market related projects is Internet-base Distributed Computing Projects web page.

Other DeepMarket Articles

• Cloud Computing
• Mobile Computers At-a-Glance
• Brokering a Sale of a Business requires Expertise
• Franchising – a better way to start a business?
• Trading the News – a look at StockPrompts

Recommended by DeepMarket

• How to sell at a higher or premium price?  (LEADS Explorer)
• Power of marketing: Selling free goods at a premium price  (LEADS Explorer)
• Why pre-promoting your booth at a trade show is wrong  (LEADS Explorer)
• Tava Tea At A Glance  (Web Chit-Chat)
• A glance at Payday advance Loans  (rossjoyner)

Ask Deep Market To Recommend Your Posts