eBay Tech Blog

From the category archives:


Announcing Kylin: Extreme OLAP Engine for Big Data

by eBay Inc. Kylin Team October 20, 2014 Cloud

We are very excited to announce that eBay has released to the open-source community our distributed analytics engine: Kylin (http://kylin.io). Designed to accelerate analytics on Hadoop and allow the use of SQL-compatible tools, Kylin provides a SQL interface and multi-dimensional analysis (OLAP) on Hadoop to support extremely large datasets. Kylin is currently used in production [...]

8 comments Read the full article →

Oink : Making Pig Self-Service

by Ruchir Shah July 22, 2014 Cloud

The Platform and Infrastructure team at eBay Inc. is happy to announce the open-sourcing of Oink – a self-service solution to Apache Pig. Pig and Hadoop overview Apache Pig is a platform for analyzing large data sets. It uses a high-level language for expressing data analysis programs, coupled with the infrastructure for evaluating these programs. Pig [...]

1 comment Read the full article →

Delivering eBay’s CI Solution with Apache Mesos – Part II

by The eBay PaaS Team May 12, 2014 Cloud

In part I of this post we laid out in detail how to run a large Jenkins CI farm in Mesos. In this post we explore running the builds inside Docker containers and more: Explain the motivation for using Docker containers for builds. Show how to handle the case where the build itself is a [...]

24 comments Read the full article →

Delivering eBay’s CI Solution with Apache Mesos – Part I

by The eBay PaaS Team April 4, 2014 Cloud

Problem statement In eBay’s existing CI model, each developer gets a personal CI/Jenkins Master instance. This Jenkins instance runs within a dedicated VM, and over time the result has been VM sprawl and poor resource utilization. We started looking at solutions to maximize our resource utilization and reduce the VM footprint while still preserving the [...]

14 comments Read the full article →

REST Commander: Scalable Web Server Management and Monitoring

by Yuanteng (Jeff) Pei March 11, 2014 Cloud

In the era of cloud and XaaS (everything as a service), REST/SOAP-based web services have become ubiquitous within eBay’s platform. We dynamically monitor and manage a large and rapidly growing number of web servers deployed on our infrastructure and systems. However, existing tools present major challenges when making REST/SOAP calls with server-specific requests to a [...]

0 comments Read the full article →

Zero Downtime, Instant Deployment and Rollback

by Suresh Mathew November 21, 2013 Cloud

Deployment to the cloud is an evolving area. While many tools are available that deploy applications to nodes (machines) in the cloud, zero deployment downtime is rare or nonexistent. In this post, we’ll take a look at this problem and propose a solution. The focus of this post is on web applications—specifically, the server-side applications [...]

16 comments Read the full article →

Validating Hadoop Platform Releases

by Mitch Wyle October 17, 2012 Cloud

Intern Pralay Biswas submitted the following blog post at the conclusion of his summer with eBay. Pralay was one of 120 college interns welcomed into eBay Marketplaces this summer. In pioneer days, they used oxen for heavy pulling, and when one ox couldn’t budge a log, they didn’t try to grow a larger ox. We [...]

3 comments Read the full article →

Cloud Bursting for Fun and Profit

by Neal Sample March 28, 2011 Cloud

Last week, I presented eBay’s cloud adoption strategy in my keynote address at the Cloud Connect conference.  The presentation was tongue-in-cheek titled Cloud Bursting for Fun and Profit, but it did make a real case for leveraging a hybrid approach to data center operations.  (“Hybrid” means a mix of public and private compute resources.) Our case study on [...]

5 comments Read the full article →

CloudCamp Silicon Valley at eBay

by Petra Hofer February 2, 2011 Cloud

CloudCamp is an unconference (a participant-driven meeting) where early adopters of Cloud Computing technologies exchange ideas. The upcoming CloudCamp Silicon Valley on February 10 from 6pm-10pm will be hosted by eBay on our San Jose North Campus (2161 N First St, San Jose, CA 95131). This public event brings together a wide range of cloud [...]

0 comments Read the full article →
Copyright © 2011 eBay Inc. All Rights Reserved - User Agreement - Privacy Policy - Comment Policy