Saturday, October 24, 2015

Towards being better about open source personally

I attended three great open source related meetings in the last weeks. The first was our S3E2 meetup at Netflix. The second was a great conference in Raleigh - All Things Open (ATO) 2015. The third was the Research Triangle Park area Triangle Devops meetup. At all three of these I talked about why we do open source at Netflix. At the ATO 2015 conference I heard from people doing open source better than I personally am doing. These meetings inspired me to write this blog post to be more open about one of my personal projects that is struggling and motivated me to do better on this project - Prana.  Prana is our sidecar process we run alongside non-Java code to provide access to our cloud platform services. Prana(-Zuul) runs on 1000’s of servers in the Netflix cloud and is a key technology that allows Netflix to work across multiple language implementations.

When we released Prana to open source, we open sourced a version we expected to be used internally before it actually was. This was at a time where a majority of the Netflix cloud platform was looking towards adoption of RxNetty networking and reactive RPC and service hosting mechanisms. Given both RxNetty and reactive RPC were evolving at the same time, all services of Prana open source were based on, at the time, prototype codebases. Let’s call this version Prana-OSS.

While all of this external work was going on, there was a different version of Prana used internally that originated out of our Edge team. Given its origin, it was based on Zuul and Jetty for service hosting and an older internal version of Ribbon for RPC. This version, while a bit crufty due to its age, had more functionality with regards to reliability and was more battle tested in production. Let’s call this version Prana-Zuul.

Prana-Zuul is based upon our cloud platform libraries (configuration, service registration and discovery, RPC, etc). Prana-Zuul is maintained by the same cloud platform team as these base libraries. In thinking through strategically what Prana (and Prana-OSS) should become, we decided that Prana should be based on the newer supported versions of both cloud platform services and RPC. This is an evolving space in our cloud platform today and therefore we are waiting to update Prana-OSS until this cloud platform update occurs. In the meantime, we have been continuously battle hardening Prana-Zuul for our wealth of internal non-JVM customers.

This has meant that external users of Prana-OSS are using an OSS project that, while valuable, isn’t used internally. Given the code isn’t the code we use internally, this has meant that PR’s and issues on github are going unanswered. It was Christine Abernathy’s talk at ATO 2015 that reminded me that such behavior isn’t acceptable for an open source project. At Facebook, such a project would likely come to the attention of the open source project office and then executives and they would take action. To be more responsible with this project, I will post this blog article to each of the open PR’s as well as on the front readme asking people to read it to understand the status. I will also go ahead and address as many of the PR’s as I can easily to keep the code live across external contributors, knowing that we are resolving them for open source, but they will not be tested internally.

Longer term, as our cloud platform updates land in Netflix open source themselves, we will update Prana-OSS based on the roll-out of a reworked Prana version inside of Netflix. We could decide to release the current Prana-Zuul in open source instead, but the cleanup required and timing in relation to cloud platform updates makes this a less attractive option. At the point where we release this updated Prana in open source, people will see a much more healthy Prana externally.

I do apologize for the confusion and pain this caused to our Prana open source users. I hope to be better in the future. Keep me accountable, please.

Sunday, October 18, 2015

AWS re:Invent 2015 Video & Slide Presentation Links with Easy Index

As with last year, here is my quick index of all re:Invent sessions.  Please wait for a few days and I'll keep running the tool to fill in the index.  It usually takes Amazon a few weeks to fully upload all the videos and slideshares.

See below for how I created the index (with code):


WRK307 - A Well-Architected Workshop: Working with the AWS Well-Architected Framework
This workshop describes the AWS Well-Architected Framework, which enables customers to assess and improve their cloud architectures and better understand the business impact of their design decisions. It address general design principles, best practices, and guidance in four pillars of the Well-Architected Framework.  We will work in teams, assisted by AWS Solutions Architects, to review an example architecture, identifying issues, and how to improve the system.  You will need to have architecture experience to get the most from this workshop. After attending this workshop you will be able to review an architecture and identify potential issues across the four pillars of Well-Architected: security, performance efficiency, reliability, and cost optimization. Prerequisites: Architecture experience.  Optional - review the AWS Well-Architected Framework whitepaper. Capacity: To encourage the interactive nature of this workshop, the session capacity is limited to approximately 70 attendees.  Attendance is based on a first come, first served basis once onsite.  Scheduling tools in the session catalog are for planning purposes only. View Less
WRK306 - AWS Professional Services Architecting Workshop
The AWS Professional Services team will be facilitating an architecture workshop exercise for certified AWS architects, with a class size limited to 40. In this highly interactive architecture design exercise, the class will be randomly divided into teams and given a business case for which to design an effective AWS solution. Flipcharts will be provided, and students are encouraged to bring their laptops to document their designs. Each team will be expected to present their solution to the class. Prerequisites: Participants should be certified AWS Architects.  Bring your laptop. Capacity: To encourage the interactive nature of this workshop, the session capacity is limited to approximately 40 attendees.  The session will be offered twice on October 7 and twice on October 8, using the same case study for each to allow for scheduling flexibility.   Attendance is based on a first come, first served basis once onsite.  Scheduling tools in the session catalog are for planning purposes only. View Less
ARC403 - From One to Many: Evolving VPC Design
As more customers adopt Amazon VPC architectures, the features and flexibility of the service are squaring off against evolving design requirements. This session follows this evolution of a single regional VPC into a multi-VPC, multiregion design with diverse connectivity into on-premises systems and infrastructure. Along the way, we investigate creative customer solutions for scaling and securing outbound VPC traffic, securing private access to S3, managing multitenant VPCs, integrating existing customer networks through AWS Direct Connect and building a full VPC mesh network across global regions. View Less
ARC402 - Double Redundancy with AWS Direct Connect
AWS Direct Connect provides low latency and high performance connectivity to the AWS cloud by allowing the provision of physical fiber from the customer's location or data center into AWS Direct Connect points of presence. This session covers design considerations around AWS Direct Connect solutions. We will discuss how to design and configure physical and logical redundancy using both physically redundant fibers and logical VPN connectivity, and includes a live demo showing both the configuration and the failure of a doubly redundant connectivity solution. This session is for network engineers/architects, technical professionals, and infrastructure managers who have a working knowledge of Amazon VPC, Amazon EC2, general networking, and routing protocols. View Less
ARC401 - Cloud First: New Architecture for New Infrastructure
What do companies with internal platforms have to change to succeed in the cloud? The five pillars at the heart of IT solutions in the cloud are automation, fault tolerance, horizontal scalability, security, and cost-effectiveness. This talk discusses tools that facilitate the development and automate the deployment of secure, highly available microservices. The tools were developed using AWS CloudFormation, AWS SDKs, AWS CLI, Amazon RDS, and various open-source software such as Docker. The talk provides concrete examples of how these tools can help developers and architects move from beginning/intermediate AWS practitioners to cloud deployment experts. View Less
ARC348 - Seagull: How Yelp Built a Highly Fault-tolerant Distributed System for Concurrent Task Execution
Efficiently parallelizing mutually exclusively tasks can be a challenging problem when done at scale. Yelp's recent in-house product, Seagull, demonstrates how an intelligent scheduling system can use several open-source products to provide a highly scalable and fault-tolerant distributed system. Learn how Yelp built Seagull with a variety of Amazon Web Services to concurrently execute thousands of tasks that can greatly improve performance. Seagull combines open-source software like ElasticSearch, Mesos, Docker, and Jenkins with Amazon Web Services (AWS) to parallelize Yelp's testing suite. Our current use case of Seagull involves distributively running Yelp's test suite that has over 55,000 test cases. Using our smart scheduling, we can run one of our largest test suites to process 42 hours of serial work in less than 10 minutes using 200 r3.8xlarge instances from Amazon Elastic Compute Cloud (Amazon EC2). Seagull consumes and produces data at very high rates. On a typical day, Seagull writes 60 GBs of data and consumes 20 TBs of data. Although we are currently using Seagull to parallelize test execution, it can efficiently parallelize other types of independent tasks. View Less
ARC346-APAC - Scaling to 25 Billion Daily Requests Within 3 Months: Building a Global Big Data Distribution Platform on AWS (APAC track)
What if you were told that within three months, you had to scale your existing platform from 1,000 req/sec (requests per second) to handle 300,000 req/sec with an average latency of 25 milliseconds? And that you had to accomplish this with a tight budget, expand globally, and keep the project confidential until officially announced by well-known global mobile device manufacturers? That's what exactly happened to us. This session explains how The Weather Company partnered with AWS to scale our data distribution platform to prepare for unpredictable global demand. We cover the many challenges that we faced as we worked on architecture design, technology and tools selection, load testing, deployment and monitoring, and how we solved these challenges using AWS. This is a repeat session that will be translated simultaneously into Japanese, Chinese, and Korean. View Less
ARC346 - Scaling to 25 Billion Daily Requests Within 3 Months: Building a Global Big Data Distribution Platform on AWS
What if you were told that within three months, you had to scale your existing platform from 1,000 req/sec (requests per second) to handle 300,000 req/sec with an average latency of 25 milliseconds? And that you had to accomplish this with a tight budget, expand globally, and keep the project confidential until officially announced by well-known global mobile device manufacturers? That's what exactly happened to us. This session explains how The Weather Company partnered with AWS to scale our data distribution platform to prepare for unpredictable global demand. We cover the many challenges that we faced as we worked on architecture design, technology and tools selection, load testing, deployment and monitoring, and how we solved these challenges using AWS. View Less
ARC344 - How Intuit Improves Security and Productivity with AWS Virtual Networking, identity, and Account Services
Intuit has an "all in" strategy in adopting the AWS cloud. We have already moved some large workloads supporting some of our flagship products (TurboTax, Mint) and are expecting to launch hundreds of services in AWS over the coming years. To provide maximum flexibility for product teams to iterate on their services, as well as provide isolation of individual accounts from logical errors or malicious actions, Intuit is deploying every application into its own account and virtual private cloud (VPC). This talk discusses both the benefits and challenges of designing to run across hundreds or thousands of VPCs within an enterprise. We discuss the limitations of connectivity, sharing data, strategies for IAM access across account, and other nuances to keep in mind as you design your organization's migration strategy. We share our design patterns that can help guide your team in developing a plan for your AWS migration. This talk is helpful for anyone who is planning or in the process of moving a large enterprise to AWS with the difficult decisions and tradeoffs in structuring your deployment. View Less
ARC342 - Closing the Loop: Designing and Building an End-to-End Email Solution Using AWS
Email continues to be a critical medium for communications between businesses and customers and remains an important channel for building automation around sending and receiving messages. Email automation enables use cases like updating a ticketing system or a forum via email, logging and auditing an email conversation, subscribing and unsubscribing from email lists via email, transferring small files via email, and updating email contents before delivery. This session implements and presents live code that covers a use case supported by Amazon.com's seller business: how to protect your customers' privacy by anonymizing email for third-party business-to-business communication on your platform. With Amazon SES and the help of Amazon S3, AWS Lambda, and Amazon DynamoDB, we cover architecture, walk through code as we build an application live, and present a demonstration of the final implementation. View Less
ARC340 - Multi-tenant Application Deployment Models
Shared pools of resources? Microservices in containers? Isolated application stacks? You have many architectural models and AWS services to consider when you deploy applications on AWS. This session focuses on several common models and helps you choose the right path or paths to fit your application needs. Architects and operations managers should consider this session to help them choose the optimal path for their application deployment needs for their current and future architectures. This session covers services such as Amazon Elastic Compute Cloud (Amazon EC2), EC2 Container Services, AWS Lambda, and AWS CodeDeploy. View Less
ARC313 - Future Banks Live in the Cloud: Building a Usable Cloud with Uncompromising Security
Running today's largest consumer bitcoin startup comes with a target on your back and requires an uncompromising approach to security. This talk explores how Coinbase is learning from the past and pulling out all the stops to build a secure infrastructure behind an irreversibly transferrable digital good for millions of users. This session will cover cloud architecture, account and network isolation in the AWS cloud, disaster recovery, self-service consensus-based deployment, real-time streaming insight, and how Coinbase is leveraging practical DevOps to build the bank of the future. View Less
ARC311 - Decoding the Genetic Blueprint of Life on a Cloud Connected Ecosystem
Thermo Fisher Scientific, a world leader in biotechnology, has built a new polymerase chain reaction (PCR) system for DNA sequencing. Designed for low- to midlevel throughput laboratories that conduct real time PCR experiments, the system runs on individual QuantStudio devices. These devices are connected to Thermo Fisher's cloud computing platform, which is built on AWS using Amazon EC2, Amazon DynamoDB, and Amazon S3. With this single platform, applied and clinical researchers can learn, analyze, share, collaborate, and obtain support. Researchers worldwide can now collaborate online in real time and access their data wherever and whenever necessary. Laboratories can also share experimental conditions and results with their partners while providing a uniform experience for every user and helping to minimize training and errors. The net result is increased collaboration, faster time to market, fewer errors, and lower cost. We have architected a solution that uses Amazon EMR, DynamoDB, Amazon Elasticache, and S3. In this presentation, we share our architecture, lessons learned, best design patterns for NoSQL, strategies for leveraging EMR with DynamoDB, and a flexible solution that our scientist use. We also share our next step in architecture evolution. View Less
ARC310-APAC - Amazon.com: Solving Amazon's Catalog Contention and Cost with Amazon Kinesis (APAC track)
The Amazon.com product catalog receives millions of updates each hour across billions of products, and many of the updates involve comparatively few products. In this... View More
ARC310 - Amazon.com: Solving Amazon's Catalog Contention and Cost with Amazon Kinesis
The Amazon.com product catalog receives millions of updates an hour across billions of products with many of the updates concentrated on comparatively few products. In this session, hear how Amazon.com has used Amazon Kinesis to build a pipeline orchestrator that provides sequencing, optimistic batching, and duplicate suppression whilst at the same time significantly lowering costs. This session covers the architecture of that solution and draws out the key enabling features that Amazon Kinesis provides. This talk is intended for those who are interested in learning more about the power of the distributed log and understanding its importance for enabling OLTP just as DHT is for storage. View Less
ARC309 - From Monolithic to Microservices: Evolving Architecture Patterns in the Cloud
Gilt, a billion dollar e-commerce company, implemented a sophisticated microservices architecture on AWS to handle millions of customers visiting their site at noon every day. The microservices architecture pattern enables independent service scaling, faster deployments, better fault isolation, and graceful degradation. In this session, Derek Chiles, AWS solutions architect, will review best practices and recommended architectures for deploying microservices on AWS. Adrian Trenaman, SVP of engineering at Gilt, will share Gilt's experiences and lessons learned during their evolution from a single monolithic Rails application in a traditional data center to more than 300 Scala/Java microservices deployed in the cloud. View Less
ARC308-APAC - The Serverless Company with AWS Lambda: Streamlining Architecture with AWS (APAC track)
In today's competitive environment, startups are increasingly focused on eliminating any undifferentiated heavy lifting. Come learn about various architectural patterns for building scalable, function-rich data processing systems using AWS Lambda and other AWS managed services. Find out how PlayOn! Sports went from a multi-layered architecture for video streaming to a streamlined and serverless system by using AWS Lambda and Amazon S3. This is a repeat session that will be translated simultaneously into Japanese, Chinese, and Korean. View Less
ARC308 - The Serverless Company Using AWS Lambda: Streamlining Architecture with AWS
In today's competitive environment, startups are increasingly focused on eliminating any undifferentiated heavy lifting. Come learn about various architectural patterns for building a scalable, function-rich data processing systems, using AWS Lambda and other AWS managed services. Come see how PlayOn! Sports went from a multi-layered architecture for video streaming to a streamlined and serverless system using Lambda and Amazon S3. View Less
ARC307 - Infrastructure as Code
While many organizations have started to automate their software develop processes, many still engineer their infrastructure largely by hand. Treating your infrastructure just like any other piece of code creates a “programmable infrastructure” that allows you to take full advantage of the scalability and reliability of the AWS cloud. This session will walk through practical examples of how AWS customers have merged infrastructure configuration with application code to create application-specific infrastructure and a truly unified development lifecycle. You will learn how AWS customers have leveraged tools like CloudFormation, orchestration engines, and source control systems to enable their applications to take full advantage of the scalability and reliability of the AWS cloud, create self-reliant applications, and easily recover when things go seriously wrong with their infrastructure. View Less
ARC305 - Self-service Cloud Services: How J&J Is Managing AWS at Scale for Enterprise Workloads
Johnson & Johnson is a global health care leader with 270 operating companies in 60 countries. Operating at this scale requires a decentralized model that supports the autonomy of the different companies under the J&J umbrella, while still allowing knowledge and infrastructure frameworks to be shared across the different businesses. To address this problem, J&J created an Amazon VPC, which provides simplified architecture patterns that J&J's application teams leveraged throughout the company using a self-service model while adhering to critical internal controls. Hear how J&J leveraged Amazon S3, Amazon Redshift, Amazon RDS, Amazon DynamoDB, and Amazon Kinesis to develop these architecture patterns for various use cases, allowing J&J's businesses to use AWS for its agility while still adhering to all internal policies automatically. Learn how J&J uses this model to build advanced analytic platforms to ingest large streams of structured and unstructured data, which minimizes the time to insight in a variety of areas, including physician compliance, bioinformatics, and supply chain management. View Less
ARC304 - Designing for SaaS: Next-Generation Software Delivery Models on AWS
SaaS architectures can be deployed onto AWS in a number of ways, and each optimizes for different factors from security to cost optimization. Come learn more about common deployment models used on AWS for SaaS architectures and how each of those models are tuned for customer specific needs. We will also review options and tradeoffs for common SaaS architectures, including cost optimization, resource optimization, performance optimization, and security and data isolation. View Less
ARC303 - Pure Play Video OTT: A Microservices Architecture in the Cloud
An end-to-end, over-the-top (OTT) video system is built of many interdependent architectural tiers, ranging from content preparation, content delivery, and subscriber and entitlement management, to analytics and recommendations. This talk will provide a detailed exploration of how to architect a media platform that allows for growth, scalability, security, and business changes at each tier, based on real-world experiences delivering over 100 Gbps of concurrent video traffic with 24/7/365 linear TV requirements. Finally, learn how Verizon uses AWS, including Amazon Redshift and Amazon Elastic MapReduce, to power its recently launched mobile video application Go90. Using a mixture of AWS services and native applications, we address the following scaling challenges:     Content ingest, preparation, and distribution     Operation of a 24x7x365 Linear OTT Playout Platform     Common pitfalls with transcode and content preperation     Multi-DRM and packaging to allow cross platform playback     Efficient delivery and multi-CDN methodology to allow for a perfect experience globally     Kinesis as a dual purpose system for both analytics and concurrency access management     Integration with Machine Learning for an adaptive recommendation system, with real time integration between content history and advertising data     User, entitlement, and content management     General best practices for ‘Cloud Architectures' and their integration with Amazon Web Services; Infrastructure as Code, Disposable and immutable infrastructure, code deployment & release management, DevOps and Microservices Architectures This session is great for architects, engineers, and CTOs within media and entertainment or others simply interested in decoupled architectures. View Less
ARC302 - Running Lean Architectures: How to Optimize for Cost Efficiency
Whether you're a cash-strapped startup or an enterprise optimizing spend, it pays to run cost-efficient architectures on AWS. This session reviews a wide range of cost planning, monitoring, and optimization strategies, featuring real-world experience from AWS customers. We'll cover how you can effectively combine EC2 On-Demand, Reserved, and Spot instances to handle different use cases, leveraging auto scaling to match capacity to workload, choosing the most optimal instance type through load testing, taking advantage of multi-AZ support, and using CloudWatch to monitor usage and automatically shut off resources when not in use. We'll discuss taking advantage of tiered storage and caching, offloading content to Amazon CloudFront to reduce back-end load, and getting rid of your back end entirely, by leveraging AWS high-level services. We will also showcase simple tools to help track and manage costs, including the AWS Cost Explorer, Billing Alerts, and Trusted Advisor. This session will be your pocket guide for running cost effectively in the Amazon cloud. View Less
ARC301 - Scaling Up to Your First 10 Million Users
Cloud computing gives you a number of advantages, such as the ability to scale your web application or website on demand. If you have a new web application and want to use cloud computing, you might be asking yourself, "Where do I start?" Join us in this session to understand best practices for scaling your resources from zero to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud. View Less
ARC201 - Microservices Architecture for Digital Platforms with AWS Lambda, Amazon CloudFront and Amazon DynamoDB
Digital platforms are by nature resource intensive, expensive to build, and difficult to manage at scale. What if we can change this perception and help AWS customers architect a digital platform that is low cost and low maintenance? This session describes the underlying architecture behind dam.deep.mg, the Digital Asset Management system built by Mitoc Group and powered by AWS abstracted services like AWS Lambda, Amazon CloudFront, and Amazon DynamoDB. Eugene Istrati, the CTO of Mitoc Group, will dive deep into their approach to microservices architecture on serverless environments and demonstrate how anyone can architect AWS abstracted services to achieve high scalability, high availability, and high performance without huge efforts or expensive resources allocation. View Less
WRK304 - Build a Recommendation Engine and Use Amazon Machine Learning in Real Time
Build an exciting machine learning model for recommending top restaurants for a customer in real time based on past orders and viewing history. In this guided session you will get hands on with data cleansing, building AML model and doing real time predictions. Dataset will be provided. Prerequisites: Participants should have an AWS account established and available for use during the workshop.  Participants should bring their own laptop.    Capacity: To encourage the interactive nature of this workshop, the session capacity is limited to approximately 70 attendees.  Attendance is based on a first come, first served basis once onsite.  Scheduling tools in the session catalog are for planning purposes only. View Less
WRK303 - Real-World Data Warehousing with Amazon Redshift and Big Data Solutions from AWS Marketplace
In this workshop, you will work with other attendees as a small team to build an end-to-end data warehouse using Amazon Redshift and by leveraging key AWS Marketplace partners. Your team will learn how to build a data pipeline using an ETL partner from the AWS Marketplace, to perform common validation and aggregation tasks in a data ingestion pipeline.  Your team will then learn how to build dashboards and reports using a Data visualization partner from AWS Marketplace, for interactive analysis of large datasets in Amazon Redshift. In less than 2 hours your team will build a fully functional solution to discover meaningful insights from raw-datasets. The session also showcase on how you can extend this solution further to create a near real-time solution by leveraging Amazon Kinesis and other AWS Big Data services. Prerequisites: Hands-on experience with AWS. Some prior experience with Databases, SQL and familiarity with data-warehousing concepts. Capacity: To encourage the interactive nature of this workshop, the session capacity is limited to approximately 70 attendees.  Attendance is based on a first come, first served basis once onsite.  Scheduling tools in the session catalog are for planning purposes only.   View Less
WRK301 - Implementing Twitter Analytics Using Spark Streaming, Scala, and Amazon EMR
Over the course of this workshop, we will launch a Spark Custer and deploy a Spark streaming application written in Scala that analyzes popular tags flowing out of Twitter.  Along the way we will learn about AWS EMR, Spark, Spark Streaming, Scala, and how to deploy applications into Spark clusters on AWS EMR. Prerequisites: Participants are expected be familiar with building modest-size applications in Scala. Participants should have an AWS account established and available for use during the workshop.  Please bring your laptop. Capacity: To encourage the interactive nature of this workshop, the session capacity is limited to approximately 70 attendees.  Attendance is based on a first come, first served basis once onsite.  Scheduling tools in the session catalog are for planning purposes only.   View Less
BDT404 - Building and Managing Large-Scale ETL Data Flows with AWS Data Pipeline and Dataduct
As data volumes grow, managing and scaling data pipelines for ETL and batch processing can be daunting. With more than 13.5 million learners worldwide, hundreds of courses, and thousands of instructors, Coursera manages over a hundred data pipelines for ETL, batch processing, and new product development. In this session, we dive deep into AWS Data Pipeline and Dataduct, an open source framework built at Coursera to manage pipelines and create reusable patterns to expedite developer productivity. We share the lessons learned during our journey: from basic ETL processes, such as loading data from Amazon RDS to Amazon Redshift, to more sophisticated pipelines to power recommendation engines and search services. Attendees learn: Do's and don'ts of Data Pipeline Using Dataduct to streamline your data pipelines How to use Data Pipeline to power other data products, such as recommendation systems What's next for Dataduct View Less
BDT403 - Best Practices for Building Real-time Streaming Applications with Amazon Kinesis
Amazon Kinesis is a fully managed, cloud-based service for real-time data processing over large, distributed data streams. Customers who use Amazon Kinesis can continuously capture and process real-time data such as website clickstreams, financial transactions, social media feeds, IT logs, location-tracking events, and more. In this session, we first focus on building a scalable, durable streaming data ingest workflow, from data producers like mobile devices, servers, or even a web browser, using the right tool for the right job. Then, we cover code design that minimizes duplicates and achieves exactly-once processing semantics in your elastic stream-processing application, built with the Kinesis Client Library. Attend this session to learn best practices for building a real-time streaming data architecture with Amazon Kinesis, and get answers to technical questions frequently asked by those starting to process streaming events. View Less
BDT402 - Delivering Business Agility Using AWS
Wipro is one of India's largest publicly traded companies and the seventh largest IT services firm in the world. In this session, we showcase the structured methods that Wipro has used in enabling enterprises to take advantage of the cloud. These cover identifying workloads and application profiles that could benefit, re-structuring enterprise application and infrastructure components for migration, rapid and thorough verification and validation, and modifying component monitoring and management. Several of these methods can be tailored to the individual client or functional context, so specific client examples are presented. We also discuss the enterprise experience of enabling many non-IT functions to benefit from the cloud, such as sales and training. More functions included in the cloud increase the benefit drawn from a cloud-enabled IT landscape. Session sponsored by Wipro. View Less
BDT401 - Amazon Redshift Deep Dive: Tuning and Best Practices
Get a look under the covers: Learn tuning best practices for taking advantage of Amazon Redshift's columnar technology and parallel processing capabilities to improve your delivery of queries and improve overall database performance. This session explains how to migrate from existing data warehouses, create an optimized schema, efficiently load data, use work load management, tune your queries, and use Amazon Redshift's interleaved sorting features. Finally, learn how TripAdvisor uses these best practices to give their entire organization access to analytic insights at scale.  View Less
BDT324 - Big Data Optimized for the AWS Cloud
Apache Hadoop is now a foundational platform for big data processing and discovery that drives next-generation analytics. While Hadoop was designed when cloud models were in their infancy, the open source platform works remarkably well in production environments in the cloud. This talk will cover use cases for running big data in the cloud and share examples of organizations that have experienced real-world success on AWS. We will also look at new software and hardware innovations that are helping companies get more value from their data. Session sponsored by Intel. View Less
BDT323 - Amazon EBS and Cassandra: 1 Million Writes Per Second on 60 Nodes
With the introduction of Amazon Elastic Block Store (EBS) GP2 and recent stability improvements, EBS has gained credibility in the Cassandra world for high performance workloads. By running Cassandra on Amazon EBS, you can run denser, cheaper Cassandra clusters with just as much availability as ephemeral storage instances. This talk walks through a highly detailed use case and configuration guide for a multi PetaByte, million write per second cluster that needs to be high performing and cost efficient. We explore the instance type choices, configuration, and low-level tuning that allowed us to hit 1.3 million writes per second with a replication factor of 3 on just 60 nodes. View Less
BDT322 - How Redfin and Twitter Leverage Amazon S3 to Build Their Big Data Platforms
Analyzing large data sets requires significant compute and storage capacity that can vary in size based on the amount of input data and the analysis required. This characteristic of big data workloads is ideally suited to the pay-as-you-go cloud model, where applications can easily scale up and down based on demand. Learn how Amazon S3 can help scale your big data platform. Hear from Redfin and Twitter about how they build their big data platforms on AWS and how they use S3 as an integral piece of their big data platforms. View Less
BDT320 - NEW LAUNCH! Streaming Data Flows with Amazon Kinesis Firehose and Amazon Kinesis Analytics
Amazon Kinesis Firehose is a fully-managed, elastic service to deliver real-time data streams to Amazon S3, Amazon Redshift, and other destinations. In this session, we start with overviews of Amazon Kinesis Firehose and Amazon Kinesis Analytics. We then discuss how Amazon Kinesis Firehose makes it even easier to get started with streaming data, without writing a stream processing application or provisioning a single resource. You learn about the key features of Amazon Kinesis Firehose, including its companion agent that makes emitting data from data producers even easier. We walk through capture and delivery with an end-to-end demo, and discuss key metrics that will help developers and architects understand their streaming data flow. Finally, we look at some patterns for data consumption as the data streams into S3. We show two examples: using AWS Lambda, and how you can use Apache Spark running within Amazon EMR to query data directly in Amazon S3 through EMRFS. View Less
BDT319 - NEW LAUNCH! Amazon QuickSight: Very Fast, Easy-to-Use, Cloud-native Business Intelligence
Amazon QuickSight is a very fast, cloud-powered business intelligence (BI) service that makes it easy to build visualizations, perform ad-hoc analysis, and quickly get business insights from your data. In this session, we demonstrate how you can point Amazon QuickSight to AWS data stores, flat files, or other third-party data sources and begin visualizing your data in minutes. We also introduce SPICE -  a new Super-fast, Parallel, In-memory, Calculation Engine in Amazon QuickSight, which performs advanced calculations and render visualizations rapidly without requiring any additional infrastructure, SQL programming, or dimensional modeling, so you can seamlessly scale to hundreds of thousands of users and petabytes of data. Lastly, you will see how Amazon QuickSight provides you with smart visualizations and graphs that are optimized for your different data types, to ensure the most suitable and appropriate visualization to conduct your analysis, and how to share these visualization stories using the built-in collaboration tools. View Less
BDT318 - Netflix Keystone: How Netflix Handles Data Streams Up to 8 Million Events Per Second
In this session, Netflix provides an overview of Keystone, their new data pipeline. The session covers how Netflix migrated from Suro to Keystone, including the reasons behind the transition and the challenges of zero loss while processing over 400 billion events daily. The session covers in detail how they deploy, operate, and scale Kafka, Samza, Docker, and Apache Mesos in AWS to manage 8 million events & 17 GB per second during peak. View Less
BDT317 - Building a Data Lake on AWS
Conceptually, a data lake is a flat data store to collect data in its original form, without the need to enforce a predefined schema. Instead, new schemas or views are created “on demand”, providing a far more agile and flexible architecture while enabling new types of analytical insights. AWS provides many of the building blocks required to help organizations implement a data lake. In this session, we will introduce key concepts for a data lake and present aspects related to its implementation. We will discuss critical success factors, pitfalls to avoid as well as operational aspects such as security, governance, search, indexing and metadata management. We will also provide insight on how AWS enables a data lake architecture.   A data lake is a flat data store to collect data in its original form, without the need to enforce a predefined schema. Instead, new schemas or views are created "on demand", providing a far more agile and flexible architecture while enabling new types of analytical insights. AWS provides many of the building blocks required to help organizations implement a data lake. In this session, we introduce key concepts for a data lake and present aspects related to its implementation. We discuss critical success factors and pitfalls to avoid, as well as operational aspects such as security, governance, search, indexing, and metadata management. We also provide insight on how AWS enables a data lake architecture. Attendees get practical tips and recommendations to get started with their data lake implementations on AWS. View Less
BDT316 - Offloading ETL to Amazon Elastic MapReduce
Amgen discovers, develops, manufactures, and delivers innovative human therapeutics, helping millions of people in the fight against serious illnesses. In 2014, Amgen implemented a solution to offload ETL data across a diverse data set (U.S. pharmaceutical prescriptions and claims) using Amazon EMR. The solution has transformed the way Amgen delivers insights and reports to its sales force. To support Amgen's entry into a much larger market, the ETL process had to scale to eight times its existing data volume. We used Amazon EC2, Amazon S3, Amazon EMR, and Amazon Redshift to generate weekly sales reporting metrics. This session discusses highlights in Amgen's journey to leverage big data technologies and lay the foundation for future growth: benefits of ETL offloading in Amazon EMR as an entry point for big data technologies; benefits and challenges of using Amazon EMR vs. expanding on-premises ETL and reporting technologies; and how to architect an ETL offload solution using Amazon S3, Amazon EMR, and Impala. View Less
BDT314 - Running a Big Data and Analytics Application on Amazon EMR and Amazon Redshift with a Focus on Security
No matter the industry, leading organizations need to closely integrate, deploy, secure, and scale diverse technologies to support workloads while containing costs. Nasdaq, Inc.-a leading provider of trading, clearing, and exchange technology-is no exception. After migrating more than 1,100 tables from a legacy data warehouse into Amazon Redshift, Nasdaq, Inc. is now implementing a fully-integrated, big data architecture that also includes Amazon S3, Amazon EMR, and Presto to securely analyze large historical data sets in a highly regulated environment. Drawing from this experience, Nasdaq, Inc. shares lessons learned and best practices for deploying a highly secure, unified, big data architecture on AWS. Attendees learn: Architectural recommendations to extend an Amazon Redshift data warehouse with Amazon EMR and Presto. Tips to migrate historical data from an on-premises solution and Amazon Redshift to Amazon S3, making it consumable. Best practices for securing critical data and applications leveraging encryption, SELinux, and VPC. View Less
BDT313 - Amazon DynamoDB for Big Data
NoSQL is an important part of many big data strategies. Attend this session to learn how Amazon DynamoDB helps you create fast ingest and response data sets. We demonstrate how to use DynamoDB for batch-based query processing and ETL operations (using a SQL-like language) through integration with Amazon EMR and Hive. Then, we show you how to reduce costs and achieve scalability by connecting data to Amazon ElasticCache for handling massive read volumes. We'll also discuss how to add indexes on DynamoDB data for free-text searching by integrating with Elasticsearch using AWS Lambda and DynamoDB streams. Finally, you'll find out how you can take your high-velocity, high-volume data (such as IoT data) in DynamoDB and connect it to a data warehouse (Amazon Redshift) to enable BI analysis. View Less
BDT312 - Application Monitoring in a Post-Server World: Why Data Context Is Critical
The move towards microservices in Docker, EC2 and Lambda points to a shift towards shorter lived resources. These new application architectures are driving new agility and efficiency. But they, while providing developers with inherent scalability, elasticity, and flexibility, also present new challenges for application monitoring. The days of static server monitoring with a single health and status check are over. These days you need to know how your entire ecosystem of AWS EC2 instances are performing, especially since many of them are short lived and may only exist for a few minutes. With such ephemeral resources, there is no server to monitor; you need to understand performance along the lines of computation intent. And for this, you need the context in which these resources are performing. Join Kevin McGuire, Director of Engineering at New Relic, as he discusses trends in computing that we've gleaned from monitoring Docker and how they've helped us rethink how we monitor and analyze AWS. We'll dive into the case for how contextual information like instance size, AMI, availability zone and tags can be used to drive an elevated understanding of transient infrastructure behavior and how it contributes to application performance. We'll show how integrating status information gives you a more accurate view of EC2 lifecycle and health. And finally, how that information powers the ability for you to analyze and display that performance information in new and powerful ways. View Less
BDT311 - Deep Learning: Going Beyond Machine Learning
Deep learning goes beyond the traditional machine learning of big data and analytics. In this session, we will review the AWS offering, Amazon Machine Learning, and the AWS GPU-intensive family of servers that run native machine learning and deep-learning algorithms. We will also cover some basic deep-learning algorithms using open source software.  Session sponsored by Day1 Solutions. View Less
BDT310-APAC - Big Data Architectural Patterns and Best Practices on AWS (APAC track)
The world is producing an ever-increasing volume, velocity, and variety of big data. Consumers and businesses are demanding up-to-the-second (or even millisecond) analytics on their fast-moving data, in addition to classic batch processing. AWS delivers many technologies for solving big data problems. But what services should you use, why, when, and how? In this session, we simplify big data processing as a data bus comprising various stages: ingest, store, process, and visualize. Next, we discuss how to choose the right technology in each stage based on criteria such as data structure, query latency, cost, request rate, item size, data volume, durability, and so on. Finally, we provide reference architecture, design patterns, and best practices for assembling these technologies to solve your big data problems at the right cost. This is a repeat session that will be translated simultaneously into Japanese, Chinese, and Korean. View Less
BDT310 - Big Data Architectural Patterns and Best Practices on AWS
The world is producing an ever increasing volume, velocity, and variety of big data. Consumers and businesses are demanding up-to-the-second (or even millisecond) analytics on their fast-moving data, in addition to classic batch processing. AWS delivers many technologies for solving big data problems. But what services should you use, why, when, and how? In this session, we simplify big data processing as a data bus comprising various stages: ingest, store, process, and visualize. Next, we discuss how to choose the right technology in each stage based on criteria such as data structure, query latency, cost, request rate, item size, data volume, durability, and so on. Finally, we provide reference architecture, design patterns, and best practices for assembling these technologies to solve your big data problems at the right cost. View Less
BDT309 - Data Science & Best Practices for Apache Spark on Amazon EMR
Organizations need to perform increasingly complex analysis on their data - streaming analytics, ad-hoc querying and predictive analytics - in order to get better customer insights and actionable business intelligence. However, the growing data volume, speed, and complexity of diverse data formats make current tools inadequate or difficult to use. Apache Spark has recently emerged as the framework of choice to address these challenges. Spark is a general-purpose processing framework that follows a DAG model and also provides high-level APIs, making it more flexible and easier to use than MapReduce. Thanks to its use of in-memory datasets (RDDs), embedded libraries, fault-tolerance, and support for a variety of programming languages, Apache Spark enables developers to implement and scale far more complex big data use cases, including real-time data processing, interactive querying, graph computations and predictive analytics. In this session, we present a technical deep dive on Spark running on Amazon EMR. You learn why Spark is great for ad-hoc interactive analysis and real-time stream processing, how to deploy and tune scalable clusters running Spark on Amazon EMR, how to use EMRFS with Spark to query data directly in Amazon S3, and best practices and patterns for Spark on Amazon EMR. View Less
BDT307 - Zero Infrastructure, Real-Time Data Collection, and Analytics
Any fast-growing organization needs a way to manage the ever-increasing volume of data being generated across the globe and the need for real-time analysis. In this session, we walk through a real-life architecture and demonstration of how to leverage Amazon Kinesis, AWS Lambda, Amazon S3, and Amazon Redshift/Aurora for near real-time access to data being collected around the globe. We dive deep into performance, cost, and system resiliency and give you practical tools you can use today to manage your own global data ingestion pipeline and produce quality analytics in real-time without building infrastructure. View Less
BDT306 - The Life of a Click: How Hearst Publishing Manages Clickstream Analytics with AWS
Hearst Corporation monitors trending content on 250+ sites worldwide, providing metrics to editors and promoting cross-platform content sharing. To facilitate this, Hearst built a clickstream analytics platform on AWS that transmits and processes over 30 TB of data a day using AWS resources such as AWS Elastic Beanstalk, Amazon Kinesis, Spark on Amazon EMR, Amazon S3, Amazon Redshift, and Amazon Elasticsearch. In this session, learn how Hearst designed their clickstream analytics application and how you can use the same architecture to build your own and be ready to handle the changing world of clickstream data. Dive into how to do Spark streaming from an Amazon Kinesis stream, use timestamps to cleanse and validate data coming from diverse sources, and see how the system has evolved as data types have change from HTTP GET to RESTful JSON requests. Finally, see how Hearst's data scientists interact with and use cleansed data provided by the platform to perform ad hoc analyses, develop home-grown algorithms, and create visualizations and dashboards that support Hearst business stakeholders. View Less
BDT305 - Amazon EMR Deep Dive and Best Practices
Amazon EMR is one of the largest Hadoop operators in the world. In this session, we introduce you to Amazon EMR design patterns such as using Amazon S3 instead of HDFS, taking advantage of both long and short-lived clusters, and other Amazon EMR architectural best practices. We talk about how to scale your cluster up or down dynamically and introduce you to ways you can fine-tune your cluster. We will also share best practices to keep your Amazon EMR cluster cost-efficient. Finally, we dive into some of our recent launches to keep you current on our latest features. View Less
BDT303 - Running Spark and Presto on the Netflix Big Data Platform
In this session, we discuss how Spark and Presto complement the Netflix big data platform stack that started with Hadoop, and the use cases that Spark and Presto address. Also, we discuss how we run Spark and Presto on top of the Amazon EMR infrastructure; specifically, how we use Amazon S3 as our data warehouse and how we leverage Amazon EMR as a generic framework for data-processing cluster management. View Less
BDT302 - Real-World Smart Applications With Amazon Machine Learning
Have you always wanted to add predictive capabilities to your application, but haven't been able to find the time or the right technology to get started? In this session, learn how an end-to-end smart application can be built in the AWS cloud. We demonstrate how to use Amazon Machine Learning (Amazon ML) to create machine learning models, deploy them to production, and obtain predictions in real-time. We then demonstrate how to build a complete smart application using Amazon ML, Amazon Kinesis, and AWS Lambda. We walk you through the process flow and architecture, demonstrate outcomes, and then dive into the code for implementation. In this session, you learn how to use Amazon ML as well as how to integrate Amazon ML into your applications to take advantage of predictive analysis in the cloud. View Less
BDT210 - Building Scalable Big Data Solutions: Learn from Intel and AOL How to Solve Enterprise Computational Challenges in the AWS Cloud
Growing data is a massive computational challenge across the enterprise. The opportunity to draw insights from huge data sets is wide open, but traditional computing environments often can't scale to those volumes. In this session, Intel Chief Data Scientist Bob Rogers PhD  explains how developers can take advantage of technologies from Intel with the AWS platform. Also in this session, AOL Systems Architect Durga Nemani provides insights into how AOL was able to reduce the time and cost to process massive amounts of clickstream data by leveraging big data technologies in AWS.  AOL can process data as fast as possible or as cheaply as possible, depending on the SLA, by choosing the number and types of instances without any changes to the code.  Session sponsored by Intel. View Less
BDT209 - NEW LAUNCH! Amazon Elasticsearch Service for Real-time Data Analytics and Visualization
Organizations are collecting an ever-increasing amount of data from numerous sources such as log systems, click streams, and connected devices. Launched in 2009, Elasticsearch -an open-source analytics and search engine- has emerged as a popular tool for real-time analytics and visualization of data. Some of the most common use cases include risk assessment, error detection, and sentiment analysis. However, as data volumes and applications grow, managing Elasticsearch clusters can consume significant IT resources while adding little or no differentiated value to the organization. Amazon Elasticsearch Service (Amazon ES) is a managed service that makes it easy to deploy, operate, and scale Elasticsearch clusters in the AWS Cloud. Amazon ES offers the benefits of a managed service, including cluster provisioning, easy configuration, replication for high availability, scaling options, data durability, security, and node monitoring. This session presents a technical deep dive on Amazon ES. Attendees learn: Common challenges with real-time data analytics and visualization and how to address them; the benefits, reference architecture, and best practices for using Amazon ES; and data ingestion options with Amazon DynamoDB, AWS Lambda, and Amazon Kinesis. View Less
BDT208 - A Technical Introduction to Amazon Elastic MapReduce
Amazon EMR provides a managed framework which makes it easy, cost effective, and secure to run data processing frameworks such as Apache Hadoop, Apache Spark, and Presto on AWS. In this session, you learn the key design principles behind running these frameworks on the cloud and the feature set that Amazon EMR offers. We discuss the benefits of decoupling compute and storage and strategies to take advantage of the scale and the parallelism that the cloud offers, while lowering costs. Additionally, you hear from AOL's Senior Software Engineer on how they used these strategies to migrate their Hadoop workloads to the AWS cloud and lessons learned along the way. In this session, you learn the benefits of decoupling storage and compute and allowing them to scale independently; how to run Hadoop, Spark, Presto and other supported Hadoop Applications on Amazon EMR;  how to use Amazon S3 as a persistent data-store and process data directly from Amazon S3; dDeployment strategies and how to avoid common mistakes when deploying at scale; and how to use Spot instances to scale your transient infrastructure effectively. View Less
BDT207 - Real-Time Analytics In Service of Self-Healing Ecosystems
Netflix strives to provide an amazing experience to each member. To accomplish this, Netflix needs to maintain very high availability across our systems. However, at a certain scale, humans can no longer scale their ability to monitor the status of all systems, making it critical for Netflix to build tools and platforms that can automatically monitor their production environments and make intelligent real-time operational decisions to remedy the problems they identify. In this session, we discuss how Netflix uses data mining and machine learning techniques to automate decisions in real-time with the goal of supporting operational availability, reliability, and consistency. We review how we got to the current states, the lessons we learned, and the future of real-time analytics at Netflix. While Netflix's scale is larger than most other companies, we believe the approaches and technologies we discuss are highly relevant to other production environments, and audience members should come away with actionable ideas that are implementable in, and benefit, most other environments. View Less
BDT206 - How to Accelerate Your Projects with AWS Marketplace
Learn how Boeing used services from AWS and software from the AWS Marketplace to accelerate the development and launch of analysis software. This session takes you through the end-to-end process of setting up an Amazon Redshift data warehouse, combined with key software from the AWS Marketplace, to help the creation of an analysis tool. This session is ideal for data scientists, technically-inclined business execs, or IT professionals looking to transform their data into new insights. View Less
BDT205 - Your First Big Data Application on AWS
Want to get ramped up on how to use Amazon's big data web services and launch your first big data application on AWS? Join us on our journey as we build a big data application in real-time using Amazon EMR, Amazon Redshift, Amazon Kinesis, Amazon DynamoDB, and Amazon S3. We review architecture design patterns for big data solutions on AWS, and give you access to a take-home lab so that you can rebuild and customize the application yourself. View Less
WRK305 - Zombie Apocalypse Survival: Building Serverless Microservices
Zombies have taken over major metropolitan areas. The AWS Lambda Signal Corps has built a communications system to connect remaining survivors. Come learn how AWS Lambda provides a platform for building event-driven microservices, all without the need to provision, manage, and scale servers. In this workshop, we will introduce the basics of using AWS Lambda to run code in response to events from Amazon DynamoDB, S3, and API Gateway. You'll work within a team to build a secure, scalable, fault-tolerant chat service with global reach from scratch using blueprints provided by us. Unfortunately, the blueprints provided only describe a very rudimentary communications system (the engineers of the project got mysteriously ill). We are looking to you and your team to add additional real-time life saving features (e.g., food cache locations, zombie motion detectors, undead counters) to the chat platform using Lambda functions.  We will have a few special challenges for teams to complete. Rewards will be given to teams that complete all the extra-credit challenges. Prerequisites: This survival workshop is open to all developers with a basic familiarity of the AWS APIs and a general revulsion towards the undead. Participants should have an AWS account established and available for use during the workshop. Please bring your own laptop. Capacity: To encourage the interactive nature of this workshop, the session capacity is limited to approximately 70 attendees.  Attendance is based on a first come, first served basis once onsite.  Scheduling tools in the session catalog are for planning purposes only. View Less
CMP407 - Lambda as Cron: Scheduling Invocations in AWS Lambda
Do you need to run an AWS Lambda function on a schedule, without an event to trigger the invocation? This session shows how to use an Amazon CloudWatch metric and CloudWatch alarms, Amazon SNS, and Lambda so that Lambda triggers itself every minute-no external services required! From here, other Lambda jobs can be scheduled in crontab-like format, giving minute-level resolution to your Lambda scheduled tasks. During the session, we build this functionality up from scratch with a Lambda function, CloudWatch metric and alarms, sample triggers, and tasks. View Less
CMP406 - Amazon ECS at Coursera: Powering a general-purpose near-line execution microservice, while defending against untrusted code
Coursera has helped millions of students learn computer science through MOOCs ranging from Introduction to Python, to state-of-the-art Functional-Reactive Programming in Scala. Our interactive educational experience relies upon an automated grading platform for programming assignments. But, because anyone can sign up for a course on Coursera for free, our systems must defend against arbitrary code execution.   Come learn how Coursera uses AWS services such as Amazon EC2 Container Service (ECS), and Amazon Virtual Private Cloud (VPC) to power a defense-in-depth strategy to secure our infrastructure against bad actors. We have modified the Amazon ECS Agent to support security layers including kernel privilege de-escalation, and enabling mandatory access control systems. Additionally, we post-process uploaded grading container images to defang binaries.   At the core of automated grading is a general-purpose near-line & batch scheduling and execution microservice built on top of the Amazon ECS APIs. We use this flexible system to power a variety of internal services across the company including data exports for instructors, course announcement emails, data reconciliation jobs, and more.    In this session, we detail aspects of our success from implementing Docker and Amazon ECS in production, providing ideas for your own scheduling, execution and hardening requirements. View Less
CMP405 - Containerizing Video: Creating the Next Generation Video Transcoding Pipeline
Media delivery requirements are continually changing, driven by accelerating mobile, tablet, smart TV, and set-top technology advances. Media services need to deliver higher-resolution content at lower bitrates to consumers, which has traditionally been a compute-intensive undertaking with slow advancements in the adoption of video codecs, containers, and related technologies. In this session, we look at some of the existing workflow constraints, and explore a solution to process media in an agile fashion using modern, efficient codecs. We use Amazon S3 events and AWS Lambda to configure media both pre- and post-process, process content in parallel with Amazon ECS using custom containers for a high level of elastic compute density, and deliver generated media to reference protocol clients via Amazon CloudFront. We also leverage Amazon EFS for scalable, shared storage in the distributed containerized environment for video processing. Issues include: parallel processing of content using Amazon ECS, pipelining and conversion of data using AWS Lambda, building an Amazon ECS-based media transcoding cluster, and delivering next-gen media through Amazon CloudFront. View Less
CMP404 - Cloud Rendering at Walt Disney Animation Studios
Each year, the technical complexity of making the next great Walt Disney Animation Studios film increases. Animation and Visual FX studios continue to push the bounds of what is possible in computer graphics. This complexity drives rapid technological growth in both computational resources and storage to the point that it exceeds what we can physically provide with our on-premise compute cluster. As a result, we have started to adopt a hybrid approach with the cloud. This session addresses the hurdles that animation and VFX studios face and focuses on automation of 'disposable' components (specifically infrastructure, licensing, fleet management, data and dependency management in a large-scale batch workload). We apply these general cloud techniques and utilities to an animation/VFX workload and push the limits with a very large scale cloud renderfarm deployment. The team from Walt Disney Animation Studios walks through how they use cloud technologies to maximize render capacity. Learn how to leverage high-performance storage (like Amazon EFS), Amazon EC2 networking and the latest EC2 Spot features to provide a fully functional renderfarm at production-quality scale. View Less
CMP403 - AWS Lambda: Simplifying Big Data Workloads
AWS Lambda allows any Node.js app to be run at scale in a massively parallel environment with no up-front costs or planning. This session shows how to use Lambda to build dynamic analytic data flows that can be tuned as they execute, based on initial results, to provide real-time output streamed to web clients. This process enables a cost-effective and responsive user experience for ad hoc big data jobs and lets developers focus on how data is consumed and presented, instead of how it is obtained. View Less
CMP402 - Amazon EC2 Instances Deep Dive
Amazon EC2 provides a broad selection of instance types to accommodate a diverse mix of workloads. In this session, we provide an overview of the Amazon EC2 instance platform, key platform features, and the concept of instance generations. We dive into the current generation design choices of the different instance families, including General Purpose, Compute Optimized, Storage Optimized, Memory Optimized, and GPU instance.  We also detail best practices and share performance tips for getting the most out of your Amazon EC2 instances. View Less
CMP401 - Elastic Load Balancing Deep Dive and Best Practices
Elastic Load Balancing automatically distributes incoming application traffic across multiple Amazon EC2 instances for fault tolerance and load distribution. In this session, we go into detail about Elastic Load Balancing's configuration and day-to-day management, as well as its use in conjunction with Auto Scaling. We explain how to make decisions about the service and share best practices and useful tips for success. View Less
CMP311 - This One Weird API Request Will Save You Thousands: Using Spot Instances to Lower Costs and Get More Capacity
Amazon EC2 allows you to bid for and run spare EC2 capacity, known as Spot instances, in a dynamically priced market. On average, customers save 80% to 90% compared to On Demand prices by using Spot instances. Achieving these savings has historically required time and effort to find the best deals while managing compute capacity as supply and demand fluctuate. In this session, we dive into best practices and new features that will help you realize immediate cost savings, maximize compute capacity within your budget, and maintain application availability and performance with less up-front or ongoing development effort. Attendees leave with practical knowledge of Spot bidding strategies, market trends, instance selection and benchmarking, and fault-tolerant architecture with examples taken from common Spot use cases such as web services, big data/analytics, media processing, and continuous integration workloads. View Less
CMP310 - Building Robust Data Processing Pipelines Using Containers and Spot Instances
It's difficult to find off-the-shelf, open-source solutions for creating lean, simple, and language-agnostic data-processing pipelines for machine learning (ML). This session shows you how to use Amazon S3, Docker, Amazon EC2, Auto Scaling, and a number of open source libraries as cornerstones to build one. We also share our experience creating elastically scalable and robust ML infrastructure leveraging the Spot instance market. View Less
CMP307 - Using Spot Instances for Production Workloads
Spot instances have come a long way since they were first introduced. Leveraging multiple Auto Scaling groups along with AWS functionality enhancements, you can even use them effectively for real-time production workloads. The higher the flexibility of the workload, the greater the cost savings are in comparison to a conventional combination of Reserved and On-Demand instances. Join us in this session to explore these techniques along with configuration approaches that allow you to tune the risk/reward balance. View Less
CMP306 - Dynamic, On-Demand Windows HPC Clusters on AWS
In today's world, grid computing needs are dynamic due to business, market, and technology changes. With AWS, you can easily create grid computing clusters running Microsoft HPC Pack 2012 R2 to meet these dynamic computing needs. This session covers architectural patterns and best practices using Amazon EC2, Amazon S3, AWS Directory Service, and AWS CloudFormation to create on-demand Windows HPC clusters. We also review automation frameworks to more easily and dynamically provision Windows HPC clusters in an on-demand fashion. View Less
CMP305 - Deep Learning on AWS Made Easy
Deep learning is making news across the country as one of the most promising techniques in machine learning research. However, these methods are complex to implement, finicky to tune, and state-of-the-art accuracy is only achieved by a few experts in the field. In this session, we give a beginner-friendly explanation of deep learning using neural networks-what it is, what it does, and how; and introduce the concept of deep features, which allows you to obtain great performance with reduced running times and data set sizes. We then show how these methods can easily be deployed on GPU instances (G2) on Amazon EC2. View Less
CMP303 - ResearchCloud: CfnCluster and Internet2 for Enterprise HPC
Biogen built ResearchCloud for large-scale processing of research data. This extension of our infrastructure capability allows us to be more nimble, process more data, scale as needed, and collaborate with external organizations. In this session, learn about the design choices we took into account when building ResearchCloud. We cover our implementation of Internet2 and AWS Direct Connect, and the challenges we encountered when scaling to speeds of 10 gigabits. We also discuss the architecture of InstantHPC, which combines CfnCluster with GlusterFS using secure templates. View Less
CMP302 - Amazon EC2 Container Service: Distributed Applications at Scale
In recent years, containers have become a key component of modern application design. Increasingly, developers are breaking their applications apart into smaller components and distributing them across a pool of compute resources. It is relatively easy to run a few containers on your laptop, but building and maintaining an entire infrastructure to run and manage distributed applications is hard and requires a lot of undifferentiated heavy lifting. In this session, we discuss some of the core architectural principles underlying Amazon ECS, a highly scalable, high performance service to run and manage distributed applications using the Docker container engine. We walk through a number of patterns used by our customers to run their microservices platforms, to run batch jobs, and for deployments and continuous integration.  We explore the advanced scheduling capabilities of Amazon ECS and dive deep into the Amazon ECS Service Scheduler, which optimizes for long-running applications by monitoring container health, restarting failed containers, and load balancing across containers. View Less
CMP301 - AWS Lambda and the Serverless Cloud
With AWS Lambda you can easily build scalable microservices for mobile, web, and IoT applications or respond to events from other AWS services without managing infrastructure. In this session you'll see demonstrations and hear more about newly launched features, as well as a recap of the languages, tools, and features added over the last several months. We'll show you how to use Lambda to build mobile backends, create web, IoT, and voice-enabled apps, and extend both AWS and third party services by triggering Lambda functions - all without the need for servers or other infrastructure. We'll also provide productivity and performance tips for getting the most out of your Lambda functions and show how cloud native architectures use Lambda to eliminate “cold servers” and excess capacity without sacrificing scalability or responsiveness. View Less
CMP203 - NEW LAUNCH! Amazon EC2 Enhancements for the Enterprise
This week we are announcing two new enhancements for those of you who are running and managing workloads on EC2, Dedicated Hosts and Run Command.  Dedicated Hosts enable you to save money, by leveraging your investments in your own server-bound licenses including Windows Server, SQL Server, and SUSE Linux Enterprise Server, in EC2.  Using Run Command, you can remotely invoke pre-defined actions or ad-hoc scripts on groups of instances all from the EC2 Console or API, this way you can easily manage configuration change on your instances. In this session we will take a look at these two new capabilities which enhance the EC2 experience. View Less
CMP202 - Engineering Simulation and Analysis in the Cloud
Building great products, ones that are aesthetically appealing as well as functionally sound, requires cutting-edge design and engineering. Given the high cost of physical testing prototypes, engineering organizations are turning to simulation and analysis using digital models, but compute requirements for these have traditionally required expensive on-premises infrastructure. But now, engineering organizations can use high-performance computing services from AWS and solutions from AWS technology partners to innovate at scale globally, with no up-front capital infrastructure investment. In this session, AWS Partner Ansys shares how they help customers of all sizes design and engineer better products through digital simulation and analysis using HPC on AWS. View Less
CMP201 - All You Need To Know About Auto Scaling
Adapting the capacity of your compute infrastructure to the demands of your applications is the domain of Auto Scaling. Adding and removing Amazon EC2 instances is only part of the story, though - there is more to it than first meets the eye. This session introduces the basics of how to use Auto Scaling before moving on to more advanced topics such as mixing Spot and On-Demand instances to optimize cost or strategies for blue/green deployments. If you have used Auto Scaling before, you can learn about useful new features like lifecycle hooks and step scaling policies that make Auto Scaling even more widely applicable. View Less
WRK302 - Event-Driven Programming
Interested in learning about event-driven programming? In this session we will introduce you to some of the basics of using Amazon DynamoDB, its newly launched Streams feature and AWS Lambda. We will provide an overview of both AWS products and walk you through the process of building a real-world application using AWS Triggers, which combines DynamoDB Streams and AWS Lambda. Prerequisites: Basic knowledge of NoSQL databases and distributed systems. Recommended experience with Amazon DynamoDB. Bring your own laptop. Participants should have an AWS account established and available for use during the workshop. Capacity: To encourage the interactive nature of this workshop, the session capacity is limited to approximately 70 attendees.  Attendance is based on a first come, first served basis once onsite.  Scheduling tools in the session catalog are for planning purposes only.   View Less
DAT407 - Amazon ElastiCache: Deep Dive
Peek behind the scenes to learn about Amazon ElastiCache's design and architecture. See common design patterns of our Memcached and Redis offerings and how customers have used them for in-memory operations and achieved improved latency and throughput for applications. During this session, we review best practices, design patterns, and anti-patterns related to Amazon ElastiCache. View Less
DAT405 - Amazon Aurora Deep Dive
Amazon Aurora is a MySQL-compatible relational database engine that combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open source databases. Amazon Aurora is disruptive technology in the database space, bringing a new architectural model and distributed systems techniques to provide far higher performance, availability and durability than previously available using conventional monolithic database techniques. In this session, we will do a deep-dive into some of the key innovations behind Amazon Aurora, discuss best practices and configurations, and share early customer experience from the field. View Less
DAT402 - Amazon RDS PostgreSQL: Lessons Learned and Deep Dive on New Features
Learn the specifics of Amazon RDS for PostgreSQL's capabilities and extensions that make it powerful. This session begins with a brief overview of the RDS PostgreSQL service, how it provides High Availability & Durability and will then deep dive into the new features that we have released since re:Invent 2014, including major version upgrade and newly added PostgreSQL extensions to RDS PostgreSQL. During the session, we will also discuss lessons learned running a large fleet of PostgreSQL instances, including specific recommendations. In addition we will present benchmarking results looking at differences between the 9.3, 9.4 and 9.5 releases. View Less
DAT401 - Amazon DynamoDB Deep Dive: Schema Design, Indexing, JSON, Search, and More
Amazon DynamoDB is a fully managed NoSQL database service for applications that need consistent, single-digit millisecond latency at any scale. This talk explores DynamoDB capabilities and benefits in detail and discusses how to get the most out of your DynamoDB database. We go over schema design best practices with DynamoDB across multiple use cases, including gaming, AdTech, IoT, and others. We also explore designing efficient indexes, scanning, and querying, and go into detail on a number of recently released features, including JSON document support, Streams, and more. View Less
DAT312 - Using Amazon Aurora for Enterprise Workloads
Relational databases are a cornerstone of the enterprise IT landscape, powering business-critical applications of many kinds. Though they have been around for a while, current commercial relational databases have lagged behind in innovation. Amazon Aurora, a managed database service built for the cloud, is intended to change that. It targets the high-performance needs of business-critical applications with an emphasis on cost-effectiveness. In this session, we will look into how Aurora fits the needs of applications built and bought by enterprises to power their business. You will learn about the overall architecture, capabilities, and cost-effectiveness of Aurora, comparing it to current commercial database offerings. We will explore best practices for enterprises adopting Aurora for existing and new workloads, as well as strategies, tools, and techniques for migrating existing databases to Aurora. You will also hear from Expedia, one of world's leading travel companies on how they are using Amazon Aurora to power application with high performance database needs. View Less
DAT311 - Large-Scale Genomic Analysis with Amazon Redshift
Genomics analysis is one of the biggest data problems out there. With DNA sequencing finally down to an affordable cost, the current bottleneck is shifting from sequencing genomes to deriving meaning from genomes at a large scale. Learn how Human Longevity, Inc., uses Amazon Redshift to analyze thousands of whole genomes every month. Dive into their detailed architecture, including how they ingest terabytes of genomic information each day. Learn how they optimize their schema, rapidly analyzing thousands of genomes in a single query using a "select, aggregate, annotate" paradigm. Finally, learn best practices for using Amazon Redshift to accelerate research. View Less
DAT309 - Scaling Massive Content Stores with Amazon Aurora
John Newton, founder and CTO of Alfresco, describes how Amazon Aurora enables the Alfresco Content Management System to store, manage, and retrieve billions of documents and related information with fast and linear scalability. Using new techniques of information modeling, indexing, and processing with the recently launched Aurora database, Alfresco can support cloud-based workloads previously not possible for high-throughput insurance, banking, and case-based applications. This session addresses the challenges of scaling document repositories to this level; architectural approaches for coordinating data; search and storage technologies such as Aurora, Solr, Amazon EBS, and Amazon S3; the breadth of use cases that modern content systems need to support; and how to support user applications that require subsecond response times. The result is a solution that once would have required large data centers to support but can now be handled cost-effectively with AWS and Aurora. View Less
DAT308 - How Yahoo! Analyzes Billions of Events a Day on Amazon Redshift
Amazon Redshift is a fast, fully managed petabyte-scale data warehouse service that costs less than $1,000 a TB a year, under a tenth the price of most traditional data warehousing solutions. Learn how Yahoo! uses both to build a billion event a day infrastructure that is fast, easy, and cost-effective. Dive into how Yahoo performs advanced user retention and cohort analysis to make near-real time product and marketing decisions. View Less
DAT304 - Amazon RDS for MySQL: Best Practices
Learn how to monitor your database performance closely and troubleshoot database issues quickly using a variety of features provided by Amazon RDS and MySQL including database events, logs, and engine-specific features. You will also learn about the security best practices to use with Amazon RDS for MySQL as well as how to effectively move data between Amazon RDS and on-premises instances. Hear from Amazon RDS customer Airbnb about the best practices they have implemented in their RDS for MySQL architectures. View Less
DAT303 - Oracle on AWS and Amazon RDS: Secure, Fast, and Scalable
AWS and Amazon RDS provide advanced features and architectures that enable graceful migration, high performance, elastic scaling, and high availability for Oracle database workloads. Learn best practices for realizing the benefits of the cloud while reducing costs, by running Oracle on AWS in a variety of single- and multi-instance topologies. This session teaches you to take advantage of features unique to AWS and Amazon RDS to free your databases from the confines of the conventional data center. View Less
DAT302 - Relational Database Management Systems in the Cloud: Deploying SQL Server on AWS
Discover how to deploy SQL Server databases on AWS using Amazon Relational Database Service (Amazon RDS) or Amazon Elastic Compute Cloud (Amazon EC2) and the advantages of each approach. Find out how Unilever leveraged RDS for SQL Server in their architecture for their website, unileverfoodsolution.com, and how they overcame the challenges they faced. Learn how to make an educated decision and choose the solution that best fits your needs. View Less
DAT209 - NEW LAUNCH! Introducing MariaDB on Amazon RDS
We are excited to announce the immediate availability of MariaDB on Amazon RDS. You can now run your MariaDB database on AWS while taking advantage of RDS management features like automated backups, point-in-time recovery, cross-region replication, and multi-AZ deployments for high availability. In this session, you learn about how to leverage RDS to get the most out of your MariaDB database. Steven Grandchamp, Vice President and GM at MariaDB, is a participant in this session. View Less
DAT207 - Amazon Aurora: The New Amazon Relational Database Engine
In July, AWS announced the launch of Amazon Aurora, a MySQL-compatible database engine that combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open source databases. This session introduces you to Amazon Aurora, explains common use cases for the service, and helps you get started with building your first Amazon Aurora-powered application. View Less
DAT205 - NEW LAUNCH! Introduction to AWS Database Migration Service
Learn about the new AWS Database Migration Service, which helps you migrate databases with minimal downtime from on-premises and Amazon EC2 environments to Amazon RDS, Amazon Redshift, Amazon Aurora and EC2 databases. We discuss homogeneous (e.g. Oracle-to-Oracle, PostgreSQL-to-PostgreSQL, etc.) and heterogeneous (e.g. Oracle to Aurora, SQL Server to MariaDB) database migrations. We also talk about the new AWS Schema Conversion Tool that saves you development time when migrating your Oracle and SQL Server database schemas, including PL/SQL and T-SQL procedural code, to their MySQL, MariaDB and Aurora equivalents. View Less
DAT204 - NoSQL? No Worries: Building Scalable Applications on AWS NoSQL Services
In this session, we discuss the benefits of NoSQL databases and take a tour of the main NoSQL services offered by AWS-Amazon DynamoDB and Amazon ElastiCache. Then, we hear from two leading customers, Expedia and Mapbox, about their use cases and architectural challenges, and how they addressed them using AWS NoSQL services, including design patterns and best practices. You will walk out of this session having a better understanding of NoSQL and its powerful capabilities, ready to tackle your database challenges with confidence. View Less
DAT203 - Building Graph Databases on AWS
This session explores building graph databases on AWS, examining common use cases, design patterns, and best practices. We then discuss the main options for running graph databases on AWS and go deeper into the Amazon DynamoDB storage backend plugin for Titan launched earlier this year. The Amazon Fulfillment team will share their story of running the Titan graph database on DynamoDB to track inventory going in and out of the company's fulfillment network. They provide best practices on running an efficient graph database at massive scale. View Less
DAT202 - Managed Database Options on AWS
In addition to running databases in Amazon EC2, AWS customers can choose among a variety of managed database services. These services save effort, save time, and unlock new capabilities and economies. In this session, we make it easy to understand how they differ, what they have in common, and how to choose one or more. We explain the fundamentals of Amazon DynamoDB, a fully managed NoSQL database service; Amazon RDS, a relational database service in the cloud; Amazon ElastiCache, a fast, in-memory caching service in the cloud; and Amazon Redshift, a fully managed, petabyte-scale data-warehouse solution that can be surprisingly economical. We will cover how each service might help support your application, how much each service costs, and how to get started. We will also have with us Jeongsang Baek, the VP of Engineering from IGAWorks, Korea's No.1 mobile business platform, who will walk us through their architecture and share with us the key insights that they gained from using the various AWS database technologies to deliver a reliable, efficient and cost-effective experience. View Less
DAT201 - Introduction to Amazon Redshift
Learn how Amazon Redshift, our fully managed, petabyte-scale data warehouse, can help you quickly and cost-effectively analyze all your data using your existing business intelligence tools. Get an introduction to how Amazon Redshift uses massively parallel processing and scale-out architecture to ensure compute resources grow with your dataset size, and columnar, direct-attached storage to dramatically reduce I/O time. Learn how top online retailer RetailMeNot moved their largest Vertica cluster on Amazon EC2 to Amazon Redshift. See how they gain insights from clickstream, location, merchant, marketing, and operational data across desktop and mobile properties. View Less
DEV310 - CI/CD of Services with Mocking and Resiliency Testing Using AWS
At Intuit, we are migrating many services to AWS. We have developed a tool called Slingshot to automate our entire onboarding process. It sets up our AWS account; generates the Jenkins flow pipeline; and then automatically builds, tests, deploys, and promotes our applications/services in the software development pipeline. The deployment automation provides zero downtime with fast cutover and quick rollbacks. Additionally, one of the challenges of implementing CI/CD with service-oriented architectures (SOA) is reliable execution of test automation. Because every service evolves on its own schedule, having a single integrated test environment is virtually impossible. One way to handle this complexity is dependency mocking. We use the Wiremock tool, which allows users to stub for service dependencies and do resiliency testing that was hard to automate before.   View Less
DEV309 - Large-Scale Metrics Analysis in Ruby
The need to crunch large amounts of data to extract useful statistics is increasingly common. Using services like Amazon Redshift and Amazon Elastic MapReduce, we will show how you can process log data to produce helpful reports and give your analysts the tools to find useful data. We will dive deep into these systems, building a usable example from scratch using the AWS SDK for Ruby. View Less
DEV303 - Practical DynamoDB Programming in Java
Come learn practical ways to use Amazon DynamoDB and see them demonstrated with the AWS SDK for Java.  We'll show you how to build systems that dynamically transform your DynamoDB data using DynamoDB Streams and AWS Lambda.  Using the AWS Toolkit for Eclipse, we'll quickly and easily build Lambda functions that act as triggers for events in your system.  We'll cover techniques for batch processing DynamoDB data, demonstrate how to rate limit your requests to control how quickly you consume provisioned throughput, and even show you some techniques for offloading this processing to a completely managed environment in AWS Lambda. View Less
DEV302 - Hosting ASP.NET 5 applications in AWS with Docker and AWS CodeDeploy
The .NET Platform is undergoing a revolution with a new modularized .NET Framework and CoreCLR, a new cross platform runtime. ASP.NET 5 gives .NET developers the ability to develop and run their applications outside of Windows. In this session we will explore how to develop and deploy ASP.NET 5 applications on Windows with AWS CodeDeploy and Linux with Docker. For Docker we will explore using Docker with both Elastic Beanstalk and EC2 Container Service. View Less
DEV301 - Automating AWS with the AWS CLI
In this talk, you'll learn how you can use the AWS CLI to automate common administrative tasks in AWS.  We'll cover several scenarios including EBS snapshot management and S3 backups and see how to combine AWS CLI features to create powerful tools for automation.  You'll see how to develop, debug, and deploy these examples in several live, end to end examples. View Less
DEV204 - Building High-Performance Native Cloud Apps in C++
The AWS SDK for C++ is a fully featured, cross-platform, modern C++ software development kit for connecting to Amazon Web Services resources.  In this talk, we discuss how you can obtain, build, configure, and begin using the SDK to build high-performance native applications that leverage the power of the cloud. View Less
DEV203-APAC - Using Amazon API Gateway with AWS Lambda to Build Secure and Scalable APIs (APAC track)
Amazon API Gateway is a fully managed service that makes it easy for developers to create, deploy, secure, and monitor APIs at any scale.  In this presentation, you'll find out how to quickly declare an API interface and connect it with code running on AWS Lambda.  Amazon API Gateway handles all of the tasks involved in accepting and processing up to hundreds of thousands of concurrent API calls, including traffic management, authorization and access control, monitoring, and API version management.  We will demonstrate how to build an API that uses AWS Identity and Access Management (IAM) for authorization and Amazon Cognito to retrieve temporary credentials for your API calls. We will write the AWS Lambda function code in Java and build an iOS sample application in Objective C. This is a repeat session that will be translated simultaneously into Japanese, Chinese and Korean.   View Less
DEV203 - Using Amazon API Gateway with AWS Lambda to Build Secure and Scalable APIs
Amazon API Gateway is a fully managed service that makes it easy for developers to create, deploy, secure, and monitor APIs at any scale.  In this presentation, you'll find out how to quickly declare an API interface and connect it with code running on AWS Lambda.  Amazon API Gateway handles all of the tasks involved in accepting and processing up to hundreds of thousands of concurrent API calls, including traffic management, authorization and access control, monitoring, and API version management.  We will demonstrate how to build an API that uses AWS Identity and Access Management (IAM) for authorization and Amazon Cognito to retrieve temporary credentials for your API calls. We will write the AWS Lambda function code in Java and build an iOS sample application in Objective C. View Less
DEV202 - Under the Desk to the AWS Cloud with Windows PowerShell
In this session, we will examine how to use AWS Tools for Windows PowerShell to move a typical in-house application, housed on a "server under someone's desk", to the cloud. We will cover importing the server as a virtual machine image running an Amazon Virtual Private Cloud (Amazon VPC) in Amazon Elastic Compute Cloud (Amazon EC2). We will then show how to configure, maintain, and monitor the running instances by automating AWS infrastructure, including the provisioning of the AWS resources, Amazon EC2 Simple Systems Manager (SSM), and Amazon CloudWatch. View Less
DEV201 - AWS SDK For Go: Gophers Get Going with AWS
The AWS SDK for Go is now live and ready for developers to build productive applications with using the Go programming language. This session will show you how to get started using the AWS SDK for Go. We'll introduce the best practices for how to use the SDK, and how it integrates with your Go application. We will explore an example application which uses async programming with Amazon S3 and Amazon SQS to distribute tasks across multiple concurrent goroutines, and use Amazon Elastic Beanstalk to deploy and scale the application. View Less
DVO401 - Deep Dive into Blue/Green Deployments on AWS
Learn how the Blue/Green Deployment methodology combined with AWS tools and services can help reduce the risks associated with software deployment. We will illustrate common patterns and highlight ways deployment risks are mitigated by each pattern. Topics will include how services like AWS CloudFormation, AWS Elastic Beanstalk, Amazon EC2 Container Service, Amazon Route53, Auto Scaling and Elastic Load Balancing can help automate deployment. We will also address how to effectively manage deployments in the context of data model and schema changes. Learn how you can adopt blue/green for your software release processes in a cost-effective and low-risk way. View Less
DVO317 - From Local Docker Development to Production Deployments
In this session, we will learn how to define and run multi-container applications with Docker Compose. Then, we will show how to deploy and scale them seamlessly to a cluster with Docker Swarm; and how Amazon EC2 Container Service (ECS) eliminates the need to install,operate, and scale your own cluster management infrastructure. We will also walk through some best practice patterns used by customers for running their microservices platforms or batch jobs. Sample code and Compose templates will be provided on GitHub afterwards. View Less
DVO315 - Log, Monitor and Analyze your IT with Amazon CloudWatch
You may already know that you can use Amazon CloudWatch to view graphs of your AWS resources like Amazon Elastic Compute Cloud instances or Amazon Simple Storage Service.  But, did you know that you can monitor your on-premises servers with Amazon CloudWatch Logs?  Or, that you can integrate CloudWatch Logs with Elasticsearch for powerful visualization and analysis?  This session will offer a tour of the latest monitoring and automation capabilities that we've added, how you can get even more done with Amazon CloudWatch. View Less
DVO314 - USA Today Brings Shadow IT into the Light - How Gannett used Chef & AWS to standardize its infrastructure
What happens when you move from using a large, unstructured Amazon EC2 pool to an automated, secure, and auditable cloud computing strategy? Learn how Gannett went from a chaotic pool of hand-crafted Heroku instances to a culture of automation and continuous delivery with Chef. By creating a DevOps team, Gannett empowered developers to automate the full stack, monitor comprehensively, and deploy code frequently. Hear how this approach allows the entire team (Security, Finance, IT, Engineering) to buy into creating the ability to push deployments whenever necessary. View Less
DVO313 - Building Next-Generation Applications with Amazon ECS
Two trends are driving app development: The shift from the server-based web to rich applications that run on a diverse set of mobile devices and modern browsers, and the growth of microservices running in the cloud that serve these clients. The results are “connected clients” - apps with the processing power of the device that are statefully connected and scaled to the cloud. In this session, you will learn about the architecture for Meteor's JavaScript app platform, Galaxy, which uses Amazon ECS, Elastic Load Balancing, and AWS CloudFormation to provide highly available, scalable, isolated environments for stateful apps across browsers and devices. We will discuss the essential characteristics of the platform, how those are provided for, and why we decided to use Amazon ECS instead of alternatives, such as Kubernetes. We will also demonstrate the Galaxy system in production. View Less
DVO312 - Sony: Building At-Scale Services with AWS Elastic Beanstalk
Learn about Sony's efforts to build a cloud-native authentication and profile management platform on AWS. Sony engineers demonstrate how they used AWS Elastic Beanstalk (Elastic Beanstalk) to deploy, manage, and scale their applications. They also describe how they use AWS CloudFormation for resource provisioning, Amazon DynamoDB for the main database, and AWS Lambda and Amazon Redshift for log handling and analysis. This discussion focuses on best practices, security considerations, tradeoffs, and final architecture and implementation. By the end of the session, you will clearly understand how to use Elastic Beanstalk as a platform to quickly and easily build at-scale web application on AWS, and how to use Elastic Beanstalk with other AWS services to build cloud-native applications. View Less
DVO311 - Learn How Organizations Are Using Containers, Red Hat, and AWS to Achieve Extreme IT Agility and Combat Network Exploits
Red Hat is helping organizations like Duke University become more efficient by delivering environmental parity for container-based applications across physical, virtual, private cloud, and public cloud environments. Red Hat delivers a comprehensive, integrated, and modular platform for containerized application delivery across the open hybrid cloud - from the OS platform, to software-defined storage, to development and deployment, and management. Through its work with Certified Cloud Service Providers like AWS, Red Hat ensures that application containers built for Red Hat Enterprise Linux can seamlessly move across public clouds. In this session, you will learn how Duke University used containers on Red Hat Enterprise Linux and AWS to combat a denial-of-service attack; how companies are using containers to increase the quality and speed of software delivery; key considerations for implementing container-based applications that can be moved across public clouds; and challenges organizations experience when using containers and how to address them. This session is sponsored by Red Hat. View Less
DVO310 - Benefit from DevOps When Moving to AWS for Windows
During this session, we'll talk about DevOps patterns of success that favor automation and drive consistency from the onset of your cloud journey. This session explores two key concepts, pushing code and operating code when targeting AWS. We will look at Windows-specific features of services like AWS CodeDeploy, CloudFormation, OpsWorks, Elastic Beanstalk, and supporting technologies like Chef, Powershell, and Visual Studio. We will wrap up the session by discussing real customer stories where fleets of Microsoft Windows Server have been successfully operated at scale in AWS. View Less
DVO308 - Docker & ECS in Production: How We Migrated Our Infrastructure from Heroku to AWS
This session will introduce you to Empire, a new self-hosted PaaS built on top of Amazon's EC2 Container Service (ECS). Empire is a recently open-sourced project that provides a mostly Heroku-compatible API. It allows engineering teams to deploy and manage applications in a method similar to Heroku, but with the added flexibility and control of running your own ECS container instances. We'll talk about why Remind decided to move its infrastructure from Heroku to AWS, introduce you to ECS and the open source platform we built on top of it to make migration easier, and then we'll demo Empire to show you how you can try it today. View Less
DVO306 - AWS CodeDeploy: Automating Your Software Deployments
So you've written some code. Now what? How do you make it available to your customers in an efficient and reliable manner? Learn how you can use AWS CodeDeploy to easily and quickly push your application updates. This talk will introduce you to the basics of CodeDeploy: key concepts, how it works, where it fits in your release process, and some deployment strategies to get you started on the right foot. We'll walk through several demos, going from a basic sample deployment to a live update of a large multi-instance fleet, giving you a sense for how CodeDeploy can grow with your needs. View Less
DVO305 - Turbocharge Your Continuous Deployment Pipeline with Containers
"It worked on my machine!" How many times have you heard (or even said) this sentence? Keeping consistent environments across your development, test, and production systems can be a complex task. Enter containers! Containers offer a way to develop and test your application in the same environment in which it runs in production. Developers can use tools such as Docker Compose for local testing of complex applications; Jenkins and AWS CodePipeline for building and orchestration; and Amazon ECS to manage and scale their containers. Come to this session to learn how to build containers into your continuous deployment workflow, accelerating the testing and building phases and leading to more frequent software releases. Attendees will learn to use Docker containers to develop their applications and test locally with Docker Compose (or Amazon ECS local), integrate containers in building, deploy complex applications on Amazon ECS, and orchestrate continuous development workflows with CodePipeline. View Less
DVO304 - AWS CloudFormation Best Practices
AWS CloudFormation lets you model, provision, and update a collection of AWS resources with JSON templates. You can manage your Infrastructure as Code and deploy stacks from a single Amazon EC2 instance to multi-tier applications. In this session, we will explore CloudFormation best practices in planning and provisioning your AWS infrastructure. We will cover recent product updates that will help users to make the most of this service and demonstrate new features. This session will benefit both new and experienced users of CloudFormation. If you are new to AWS CloudFormation, get up to speed for this session by completing the Working with CloudFormation lab in the self-paced Labs Lounge.   View Less
DVO303 - Scaling Infrastructure Operations with AWS Service Catalog, AWS Config, and AWS CloudTrail
As the number of developers and size of your infrastructure on AWS grows, timely investments in self-service and monitoring can help you scale operations without being the bottleneck. You can standardize infrastructure configurations for commonly used products to enable your customers to self-serve infrastructure needs for their apps. Once these resources are provisioned, you can easily understand how they are connected to administer them effectively, and monitor changes to configurations and evaluate drift. In this session, we will discuss how you can achieve a sophisticated level of standardization, configuration compliance, and monitoring using a combination of AWS Service Catalog, AWS Config, and AWS CloudTrail. View Less
DVO301 - AWS OpsWorks Under the Hood
AWS OpsWorks helps you deploy and operate applications of all shapes and sizes. With AWS OpsWorks, you can model your application stack with layers that define the building blocks of your application: load balancers, application servers, databases, etc. But did you know that you can also use AWS OpsWorks to run commands or scripts on your instances? Whether you need to perform a specific task or install a new software package, AWS OpsWorks gives you the tools to install and configure your instances consistently and help them evolve in an automated and predictable fashion. In this session, we dive into how you can create custom layers and a runtime system for your operational tooling, understand the lifecycle events, and show how to develop and test locally. View Less
DVO209 - JAWS: The Monstrously Scalable Serverless Framework - AWS Lambda, Amazon API Gateway, and More!
You can now build entire applications without servers using AWS Lambda and Amazon API Gateway - JAWS just makes it easier. JAWS is an open-source application framework that provides structure, best practices, and optimizations for serverless applications through its powerful command line tool and module ecosystem. Join us as we build an application with JAWS and discuss tips and tricks for building serverless apps in general. Github: https://github.com/jaws-stack/JAWS View Less
DVO208 - Tipping Point: Mission-Critical Business Applications in the Cloud
In every industry, organizations have been looking to move their entire business, not just their back office applications, to the cloud. Until recently, mission-critical applications have not been cloud-ready. Options have been limited to point solutions from multiple vendors that require extensive integration, and cloud applications that simply lack the deep, unique functionality required by manufacturers, hospitals, banks, or hotels. In this session, hear how enterprise application suites that run critical operations and provide real-time analytics have reached the tipping point and now make it possible to run your entire business in the cloud.  Session sponsored by Infor. View Less
DVO207 - Defending Your Workloads Against the Next Zero-Day Attack
When serious vulnerabilities like Shellshock or Heartbleed are discovered, you know you should respond quickly. But when you're juggling many priorities and are more comfortable developing apps than security policies, emergency updates may fall to the bottom of the list. Is there a better way to protect your workloads without a lot of work? In AWS, your entire deployment and infrastructure is code. Your security controls have to take the same approach. When your entire stack is code, you can automate protection for zero-day vulnerabilities, without impacting your architecture or adding operational burden. In this session, you'll learn how to respond and recover from the next zero-day vulnerability. Using real-world examples, you'll see how you can combine AWS features, such as security groups, VPCs, and IAM roles with workload-aware security controls like intrusion prevention to automate your defenses. Learn simple and easy-to-deploy security techniques that protect your workloads, but don't require a PhD in cybersecurity.  Session sponsored by Trend Micro. View Less
DVO206 - Lessons from a CISO: How to Securely Scale Teams, Workloads, and Budgets
Are you a CISO in cloud or security operations and architecture? The decisions you make when migrating and securing workloads at scale in the AWS cloud have a large impact on your business. This session will help you jump-start your migration to AWS or, if you're already running workloads in AWS, teach you how your organization can secure and improve the efficiency of those deployments. Infor's Chief Information Security Officer will share what the organization learned tackling these issues at scale. You'll hear how managing a traditional large-scale infrastructure can be simplified in AWS. You'll understand why designing around the workload can simplify the structure of your teams and help them focus. Finally, you'll see what these changes mean to your CxOs and how better visibility and understanding of your workloads will drive business success.  Session sponsored by Trend Micro. View Less
DVO205 - Monitoring Evolution: From Flying Blind to Flying by Instrument
Today, AdRoll runs its infrastructure by instrumentation: constantly asking empirical questions, analyzing data for answers, and designing new features with instrumentation in mind to understand how functionality will work upon release. AdRoll's development methodology did not start out this way, however. It took a cultural shift and many new tools and processes to adopt this approach. In this session, AdRoll and Datadog will discuss how to evolve your organization from a state of “flying blind” to a culture focused on monitoring and data-based decisions.  Session sponsored by Datadog. View Less
DVO204 - Monitoring Strategies: Finding Signal in the Noise
You need to monitor only a few machines and applications before fixing issues in your environment becomes very complicated. Throw in the type of dynamic infrastructure provided by Amazon EC2, and your static monitoring strategies will most likely not scale. Knowing which metrics to watch and how to troubleshoot based on those metrics will help you solve problems more quickly. In this session, we will look at a framework for your metrics and how to use it to find solutions to the issues that come up. We will cover the three types of monitoring data; what to collect; what should trigger an alert (avoiding an alert storm); and how to follow the resources to find the root causes of problems.  Session sponsored by Datadog.   View Less
DVO203 - A Day in the Life of a Netflix Engineer Using 37% of the Internet
Netflix is a large and ever-changing ecosystem made up of: hundreds of production changes every hour, thousands of micro services, tens of thousands of instances, millions of concurrent customers, billions of metrics every minute. And I'm the guy with the pager. This is an in-the-trenches look at what operating at Netflix scale in the cloud is really like. It covers how Netflix views the velocity of innovation, expected failures, high availability, engineer responsibility, and obsessing over the quality of the customer experience. It also explains why freedom and responsibility are key, trust is required, and chaos is your friend. View Less
DVO202 - DevOps at Amazon: A Look at Our Tools and Processes
As software teams transition to cloud-based architectures and adopt more agile processes, the tools they need to support their development cycles will change. In this session, we'll take you through the transition that Amazon made to a service-oriented architecture over a decade ago. We will share the lessons we learned, the processes we adopted, and the tools we built to increase both our agility and reliability. We will also introduce you to AWS CodeCommit, AWS CodePipeline, and AWS CodeDeploy, three new services born out of Amazon's internal DevOps experience. View Less
DVO201 - Scaling Your Web Applications with AWS Elastic Beanstalk
AWS Elastic Beanstalk provides an easy way for you to quickly deploy, manage, and scale applications in the AWS cloud. Through interactive demos and code samples, this session will teach you how to deploy your code to Elastic Beanstalk, provision and use additional AWS resources (for example, Amazon SNS, Amazon SQS, and Amazon DynamoDB), use your application's health metrics to tune performance, scale your application to handle millions of requests, and perform zero-downtime deployments with traffic routing. Demos and code samples will be available to all session attendees. View Less
GAM407 - Quiplash: The Multiscreen, Multidevice, Multiplayer Game for 10,000
Jackbox Games, the makers of Fibbage and You Don't Know Jack, want everyone to be able to join the fun. They design games that thousands of people can play together at the same time from their phone, tablet, computer, or set-top box. Quiplash is their newest release, and it is THE game to play at parties, family events, and public gatherings. It combines local multiplayer with massively multiplayer so the whole room can play with the whole world. Multidevice means anyone can play, and multi-screen creates an experience that is fun for both participants and spectators.   Attend this session to hear how Jackbox Games achieved this. They describe the system architecture and technology they employed to bring Quiplash to life and explain the importance of AWS, Fire TV, and Twitch to their development process. They also discuss the design decisions that made it possible to support multiple screens and multiple devices for thousands of concurrent players. View Less
GAM406 - Glu Mobile: An Amazon Kinesis Platform to Process Real-time Analytics for 10 MM+ Devices
Glu uses Amazon Kinesis, Apache Storm, S3, and Hadoop to collect billions of data points from millions of user devices in real-time every single day. This session describes how Glu built and configured an array of producers to submit real-time gaming events into Amazon Kinesis, using temporary tokens from Amazon Cognito, removing the need for an intermediate store-forward fleet. We then discuss how we've been able to easily integrate Amazon Kinesis with powerful open-source technologies such as Apache Storm and the Hadoop ecosystem. Finally, we discuss KCL optimizations and tradeoffs to manage a scalable, flexible, mission-critical streaming data platform.   View Less
GAM405 - HTML5 vs Unity for Responsive Game Design
Game developers have lots of options when it comes to picking platforms and frameworks for building their games. If you are looking to build true cross-platform games, there are two great options: HTML5 and Unity. But knowing which one to start with can be difficult. This talk discusses the pros and cons of each platform by looking at the same game built in Phaser (http://phaser.io) and Unity. We also discuss publishing options for both platforms and how to create truly cross-platform games from a single codebase. View Less
GAM404 - Evolve: Hunting Monsters in a Low-Latency Multiplayer Game on EC2
Hear how Turtle Rock launched Evolve, their fast-paced mercenary-vs-monster first-person shooter (FPS), to millions of players using AWS regions around the globe. Turtle Rock provides an in-depth view into Evolve's architecture on AWS, including both their Amazon EC2 and Elastic Load Balancing web API stack, as well as their Crytek-based UDP game servers. Hear how they used Amazon VPC subnets, along with an RDS MySQL based server registration service, to balance players across Availability Zones and regions. Learn about Turtle Rock's innovative game server scaling logic, which maintains a pool of game server capacity while keeping costs in check. Finally, see Evolve's Graphite and Grafa monitoring setup, which provides player count and server health status across their worldwide fleet. View Less
GAM403 - From Zero to 400 Billion Stars and a Real-time Commodities Market
Elite Dangerous is a Kickstarter-backed, massive-scale space MMO by Frontier Games. With no prior experience with AWS, Frontier have used EC2, S3, RDS, DynamoDB, Elasticache, and CloudFormation to deploy a cross-platform PC & Console MMO experience that is sold and distributed worldwide.  Every action made by each of the 825,000 (and counting) Elite Dangerous players drives the combined game's story forward, and impacts a live galactic commodities market running on EC2 and RDS in real-time.  Frontier uses AWS to create a simulation of the entire 400 billion star systems of the Milky Way galaxy using physics engines running on Amazon EC2. Finally, learn how Elite distributes updates and DLC to game clients using Amazon S3 and Amazon CloudFront. View Less
GAM402 - Turbine: A Microservice Approach to Three Billion Game Requests a Day
Turbine shares lessons learned from their new microservice game platform, which used Docker, Amazon EC2, Elastic Load Balancing, and Amazon ElastiCache to scale up as the game exceeded expectations. Learn about their Docker-based microservices architecture and how they integrated it with a legacy multiplatform game-traffic stack. Turbine shares how they gracefully degraded their services rather than going down and how they dealt with unpredictable client behavior. Hear how they resharded their live MongoDB clusters while the game was running. Finally, learn how they broke their game-event traffic into a separate Kafka-based analytics system, which handled the ingestion of over two billion events a day. View Less
GAM401 - Build a Serverless Mobile Game with Amazon Cognito, Lambda, and DynamoDB
Get a hands-on walkthrough of how to quickly build a mobile game with online services like user authentication, downloadable content, and social features. Using the AWS Mobile SDK for Unity, iOS, and Android, it's easier than ever to build a game with these services. This session provides a step-by-step approach to add features to your game such as user identity management, dynamic content updates, cross-platform data sync, and more. We demonstrate how to use the AWS Mobile SDK to securely interact with services such as Amazon Cognito, Amazon DynamoDB, Amazon S3, and AWS Lambda. View Less
GAM303 - Riot Games: Migrating Mountains of Big Data to AWS
Riot Games serves an international base of players that creates terabytes of data daily.  With their data centers quickly reaching capacity, Riot Games migrated their entire warehouse to AWS in order to scale operations more effectively. Learn how Riot Games used DynamoDB and Elastic MapReduce to import millions of rows of customer metrics.  Hear about the technical specifics involved, and the lessons learned along the way of migrating large amounts of data to AWS.  View Less
GAM202 - Three New Ways to Monetize featuring Backflip Studios
The average game developer only monetizes 2-3% of their customers. What if you could monetize 100% of them? We'll talk with Bryan Mashinter from Backflip Studios about three new ways to do this. In this session you'll learn about: Amazon Underground where customers get premium apps and in-app items for free and developers get paid for all of the minutes used, Merch by Amazon a self-service on-demand t-shirt printing service that costs you nothing out of pocket, and Amazon Coins to help deepen engagement and improve your ARPU (average revenue per user) View Less
GAM201 - Cloud Gaming Architectures from Mobile to Social to MMO
In this session, AWS shares best practices for launching a game that can scale from 1,000 to 1,000,000 users, while paying only for what you use. We'll show how to create a game backend using Amazon EC2 and AWS Elastic Beanstalk. Learn about database scaling challenges, and how to use Amazon DynamoDB, Amazon RDS, and Amazon ElastiCache to address them. Then, see how to use AWS automation features such as CloudFormation to take your game to new regions worldwide.  Finally, hear how to deliver game assets efficiently using Amazon S3 and Amazon CloudFront. View Less
WRK201 - Unconference: Solving Your Business Problems with AWS
Are you currently designing or implementing business solutions on AWS? Are you eager to discuss, and have an opportunity to present, your experience creating business solutions with other AWS customers? Would you like to participate in a collaborative workshop facilitated by the AWS Solutions Builder team? If so, come participate with other AWS customers as we focus on the overall experience of using AWS to solve business problems.  This is a great opportunity to collaborate with existing and prospective AWS users to validate your thinking and direction with AWS peers, discuss the resources that aid AWS solution design, and give direct feedback on your experience building solutions on AWS.   The session will primarily consist of a collaborative, participant-driven activity, facilitated by the AWS Solutions Builder team, where we will encourage you to share your solutions-related knowledge and visions. As each team works through the exercise, you will discuss ideas, advice, or challenges when building on AWS, and identify the supporting resources and collateral you used or would like to see available.  Each team will then have the opportunity to summarize and present their ideas to the group: what you built, why it is cool, what you learned, and the challenges you faced. Prerequisites: We encourage you to come prepared to share specific business problems that you have solved or would like to solve, questions or advice for building solutions, or any pain points you encountered during the process. Capacity: To encourage the interactive nature of this workshop, the session capacity is limited to approximately 70 attendees.  Attendance is based on a first come, first served basis once onsite.  Scheduling tools in the session catalog are for planning purposes only. View Less
ISM403-APAC - How Amazon.com Is Moving to Amazon WorkSpaces (APAC track)
As a global company, Amazon.com employs over 100,000 individuals worldwide, with a range of full-time employees, contractors, partners, subsidiaries, and vendors, all of whom need some level of secure and potentially restricted access to the Amazon.com corporate network. By starting the move to Amazon WorkSpaces (WorkSpaces) in 2015, Amazon.com has centralized access to its corporate network without relying on VPN remote access or complex office networking topologies. In this session, we dive deep to show exactly how Amazon.com approached its WorkSpaces design, implementation, and rollout. In this talk, we share detailed information about Amazon VPC design considerations, including challenging IPv4 address space issues, AWS Direct Connect integrations with transitive routing, global Active Directory and Group Policy Object (GPO) deployment, content filtering, patch management, virtualized applications with Amazon WorkSpaces Application Manager (Amazon WAM), offline access with Amazon WorkDocs, device management, and disaster recovery. We also look at the long-pole migration to WorkSpaces, including the dependencies on office networking bandwidth and access points, and the move to a more decentralized networking infrastructure. Representatives from both AWS and Amazon.com will present. This is a repeat session that will be translated simultaneously into Japanese, Chinese, and Korean. View Less
ISM403 - How Amazon.com is Moving to Amazon WorkSpaces
As a global company, Amazon.com employs over 100,000 individuals worldwide, with a range of full-time employees, contractors, partners, subsidiaries, and vendors, all of whom need some level of secure and potentially restricted access to the Amazon.com corporate network. By starting the move to Amazon WorkSpaces in 2015, Amazon.com centralized access to its corporate network without relying on VPN remote access or complex office networking topologies. In this session, we will dive deep to show exactly how Amazon.com approached its WorkSpaces design, implementation, and rollout. The talk provides detailed working knowledge on multiple Amazon VPC design considerations, including challenging IPv4 address space issues, AWS Direct Connect integrations with transitive routing, global Active Directory and GPO deployment, content filtering, patch management, virtualized applications with Amazon WorkSpaces Application Manager (Amazon WAM), offline access with Amazon WorkDocs, device management, and disaster recovery considerations. This session will also look at the long-pole migration to WorkSpaces, including the dependencies on office networking bandwidth and access points, and the move to a more decentralized networking infrastructure. Representatives from both AWS and Amazon.com will be presenting. View Less
ISM402 - Cost Optimization at Scale
Intended for customers who have (or will have) thousands of instances on AWS, this session is about reducing the complexity of managing costs for these large fleets so they run efficiently. Attendees will learn about common roadblocks that prevent large customers from cost optimizing, tools they can use to efficiently remove those roadblocks, and techniques to monitor their rate of cost optimization. The session will include a case study that will talk in detail about the millions of dollars saved using these techniques. Customers will learn about a range of templates they can use to quickly implement these techniques, and also partners who can help them implement these templates. View Less
ISM319 - The Three Degrees of Freedom in the Cloud Drives the Need for Application-Defined Management
The typical Forbes Global 2000 enterprise has more than 5,000 applications. Amazon EC2 has more than 54,800 possible instance configurations for a simple three-tiered application. Managing the application lifecycle is challenging due to three interrelated degrees of freedom in the cloud: application proliferation, execution venue diversification, and the increase in the rate of change to one or both of the latter. Creating rigid, hard-wired relationships between applications and infrastructure simply won't scale. What's needed is the ability to abstract up to the application level, define each application's topology and dependencies, and use this metadata to allow the infrastructure environment to dynamically provision resources based on application criteria. This focus on the application and not just infrastructure is what's behind application-defined cloud management. Session sponsored by cliQr. View Less
ISM318 - Continuous QA: Measuring Software Quality with Rainforest QA and Mechanical Turk
Customer demand and competitive landscapes mean it's not okay to move fast and break things. Whether you are following Agile, Continuous Integration (CI) or Continuous Deployment (CD), you can't afford to limit your releases, skip quality assurance (QA) testing, or let your customers beta-test your products. You need an on-demand QA platform that moves at the speed of development. Come learn how Rainforest leverages Mechanical Turk to build its network of 50,000 QA testers around the world and deliver on-demand QA through its API. We are able to deliver QA tests in 30 minutes that don't slow down development. View Less
ISM317 - Amazon WorkMail: Secure, Corporate Email in Less Than 10 Minutes
Managing corporate email infrastructure is highly capital intensive and laborious. Amazon WorkMail does all the heavy lifting on behalf of customers, to offer the highest grade of security to organizations, along with much needed flexibility. In this session, get an inside look into how Amazon WorkMail leverages other AWS services, such as AWS KMS and AWS Directory Service, and learn more about how our customers have successfully set up their highly secure email infrastructure in just a few easy steps. View Less
ISM315 - Strategies to Quantify TCO and Increase Business Value Gains Using AWS
Do you need to develop a business case for moving to cloud or communicate business value of your investment in AWS? This session introduces you to methods and tools to help you calculate total cost of ownership (TCO) and evaluate your business value gains from AWS. In this session, you learn how to measure TCO and business value, and communicate a business case to organizations such as finance and procurement. You compare the costs of running your own IT infrastructure on-premises vs. on AWS and quantify intangible benefits. You also learn about resources available from AWS to help you engage in business value conversations with your organization's leaders and what contact is available to you for further evaluation.  View Less
ISM314 - Breaking Down the Economics and TCO of Migrating to AWS
This session is for anyone interested in understanding the financial costs associated with migrating workloads to AWS. By presenting real cases from AWS Professional Services and directly from a customer, we explore how to measure value, improve the economics of a migration project, and manage migration costs and expectations through large-scale IT transformations. We'll also look at automation tooling that can further assist and accelerate the migration process. View Less
ISM313 - Learn How Delaware North Migrated 90+ Apps, Including PCI Workloads, in Four Months Without Business Impact
Delaware North is a major presence in the food and hospitality industry, serving more than 500 million customers at 200 venues around the world each year. The company decided to move almost all of its data center operations to AWS. The migration helped Delaware North reduce its server footprint by 91 percent, achieve a projected cost savings of $3.5 million over five years, improve PCI compliance and disaster recovery, and vastly streamline the delivery of new services and solutions internally and to its business customers. This session is for executives and enterprise architects who want to learn how a large enterprise organization adapted their teams, tooling, and methodology to successfully migrate their business-critical functions to the cloud. You will learn about the tried and tested methodology we used including: the four main stages of the migration factory; tooling for discovery, team collaboration, build and migration; how we worked alongside the Delaware North security team and their external QSAs to agree on the approach for adhering to compliance and regulations; how we developed scripts to automate as much of the workload as possible including the auditing of dangerous security groups; and the team and skill sets we needed for the migration to be successful. This session is sponsored by Cloudreach. View Less
ISM312 - Stories from the Road: SMB Panel-Using the Cloud to Achieve Business Agility
The cloud levels the playing field. Organizations of all sizes can access and affordably use the latest technology to deliver on their corporate missions. Join AWS Premier Consulting Partner Cloudnexa and a panel of IT executives to learn how and why their organizations use the cloud to deliver on their corporate technology objectives. Hear about the architectural challenges they faced, cloud implementation strategies they considered and used, IT barriers they overcame, and how their cloud deployments evolved with their organizations. You'll also have an opportunity to join in the discussion. View Less
ISM311 - How FINRA Gains End-to-End Visibility into Its Large-Scale AWS Environment
Building applications in the cloud brings promises of increased speed and agility at a lower cost. But you only realize these benefits if your cloud infrastructure is secure and well-managed. Learn how FINRA manages its AWS environment through ensuring security and compliance, project cost management, and optimization of compute and storage resources. In this session, FINRA will discuss the AWS shared-responsibility model, a new developer responsibility paradigm, and how to leverage various collection methods to address new cloud-based responsibilities.  Session sponsored by Splunk. View Less
ISM310 - Enterprise Integration Strategy: Scholastic's Approach to Integration as a Service
As a global publishing house, Scholastic Corporation has brought to market titles such as Clifford the Big Red Dog and series like Harry Potter and The Hunger Games. Scholastic is in the midst of a multi-year technology transformation, which will move it out of the data center business and all-in on AWS. This session will discuss Scholastic's DevOps model, which has allowed it to quickly deploy traditional software systems to AWS. It will also discuss how Scholastic addressed enterprise integration challenges by developing “Integration as a Service” and building parallel feeds into Amazon Redshift and other AWS data warehouse and analytics platforms. View Less
ISM309 - Efficient Innovation:High-Velocity Cost Management at Netflix
At many high-growth companies, staying at the bleeding edge of innovation and maintaining the highest level of service availability often sideline financial efficiency. This problem is exacerbated in a micro-service environment, where decentralized engineering teams can spin up thousands of instances at a moment's notice, with no governing body tracking cost. By developing a cost-conscious culture and assigning the responsibility for efficiency to the appropriate business owners, you can deliver innovation efficiently and cost effectively . At Netflix, the Finance and Operations Engineering teams bear the responsibility for ensuring that the rate of innovation is fast and that development is cost effective. In this presentation, we'll explore the building blocks of AWS cost management and discuss Netflix's best practices. View Less
ISM308 - Keep Cloud Transformation on Track: Nine Best Practices to Avoid or Break Through a Stalled Cloud Transformation Program
You've successfully completed proofs-of-concept using the cloud. You've staffed a cross-functional cloud tiger team to define standards. You've communicated broadly and won executive support. Why is your cloud transformation program stalling? If this sounds familiar, know that you're not alone. Many organizations experience program delays, with some delays lasting 12 months or longer. We spoke with leaders, project consultants, and engineers from mature organizations that have successfully accelerated through program delays. In this session, we discuss what we learned about why cloud transformation programs stall even when you do everything right and share nine best practices for avoiding or breaking through a delay. View Less
ISM307 - Migrating Fox's Media Supply Chains to the Cloud with AWS
The Fox Network Engineering and Operations group collects, prepares, and packages all incoming media for multiplatform distribution, and creates the substantial infrastructure that supports this distribution. In conjunction with SDVI Corporation, the group has created an AWS-resident resource management system to share media processing workloads across the group's existing facility, a private cloud, and AWS; to dynamically provision and scale resources as required; and to automate the entire flow of the group's media supply chain. Designed for anyone wanting to implement a public/private/hybrid supply chain and identify the benefits, this presentation will help you understand how this paradigm shift not only allowed Fox to migrate from a capital-intensive operation to an operational expenditure (OPEX) model, but also how it gives Fox the agility to spin up new services on demand to reach revenue sooner and match infrastructure spending directly to revenue generation. View Less
ISM305 - AWS Cloud Adoption Framework: Create Your Cloud Strategy and Accelerate Time to Results
Dive deep into specific, common use cases for enterprise customers while stepping through the process of building a cloud and IT transformation strategy leveraging the AWS Cloud Adoption Framework. We will build a prescriptive roadmap for a cloud journey leveraging best practices, common techniques, and real-world examples from other AWS successes. View Less
ISM304 - From Oracle to Amazon RDS MySQL and Amazon Aurora: How Gallup Made the Move
Amazon RDS MySQL offers a highly scalable, available and high performing database service at a fraction of the cost of a commercially licensed database provider. To take advantage of Amazon RDS MySQL benefits such as Multi-AZ replication and ease of administration, Gallup transitioned its Reporting and Analytics platforms to AWS. Swapan Golla, Technical Architect at Gallup, will talk about the benefits the company has seen moving from an on-premise Oracle deployment to RDS MySQL. Learn about the solution architecture and how they tuned their schemas and application code to take full advantage of the scalability and performance of RDS. He will also talk about the next steps in the team's roadmap, which involve Amazon Aurora. View Less
ISM303 - Migrating Your Enterprise Data Warehouse to Amazon Redshift
Learn how Boingo Wireless and online media provider Edmunds gained substantial business insights and saved money and time by migrating to Amazon Redshift. Get an inside look into how they accomplished their migration from on-premises solutions. Learn how they tuned their schema and queries to take full advantage of the columnar MPP architecture in Amazon Redshift, how they leveraged third party solutions, and how they met their business intelligence needs in record time. View Less
ISM301 - Engineering Netflix Global Operations in the Cloud
Operating a massively scalable, constantly changing, distributed global service is a daunting task. We innovate at breakneck speed to attract new customers and stay ahead of the competition. This means more features, more experiments, more deployments, more engineers making changes in production environments, and ever-increasing complexity. Simultaneously improving service availability and accelerating rate of change seems impossible on the surface. At Netflix, operations engineering is both a technical and organizational construct designed to accomplish just that by integrating disciplines like continuous delivery, fault injection, regional traffic management, crisis response, best practice automation, and real-time analytics. In this talk, designed for technical leaders seeking a path to operational excellence, we'll explore these disciplines in depth and how they integrate and create competitive advantages. View Less
ISM215 - SAP on AWS: Why Brooks Brothers Decided to Move Their Production SAP to the Cloud
Many organizations that rely on SAP are challenged by supporting and scaling their on-premises mission-critical SAP environments. Whether extending on-premises environments or fully migrating, organizations running SAP can realize several compelling benefits from the cloud. Brooks Brothers, a leader in the fashion industry, chose the AWS Cloud as their target platform for SAP. Learn why Brooks Brothers decided to evaluate alternatives before investing in their on-premises infrastructure, the process they used to decide, and why they ultimately went with AWS. You'll also learn how SAP and AWS are working together to support SAP customers, and hear about best practices from AWS SAP experts. View Less
ISM214 - Learn How Air Liquide Transformed Operations and Reduced IT Costs by 30%
Air Liquide, a multinational resources company, transformed operations by creating a hybrid cloud environment that leverages the Accenture Cloud Platform to provide fully managed services and the scale and agility of the AWS cloud. In six months, Air Liquide created a pay-as-you-go model for IaaS and PaaS, driving down costs by 30 percent by moving more than 1,700 servers onto cloud platforms. The change also improved the business users' experience by providing them the ability to manage their budgets and by increasing flexibility and accountability. This session is sponsored by Accenture. View Less
ISM213 - Building and Deploying a Modern Big Data Architecture on AWS
The AWS platform enables large enterprises to use data to solve business problems and uncover opportunities more easily and affordably than ever before. However, to truly take advantage of AWS, enterprises need a way to collect, store, process, analyze, and continually execute on their data. Datapipe has been an AWS partner for more than five years. In that time, it has developed a proprietary process for the deployment of AWS environments, as well as the processing and evaluation of big data analytics to optimize these environments over time. This flexible solution includes automation tools, continuous monitoring, and cloud analytics. It protects against architectural sprawl and continually redesigns for scalability. This kind of continuous build environment allows Datapipe to examine the AWS environment as a complete picture and ensure the cloud environment is running as efficiently and effectively as possible, ultimately reducing overhead costs for the enterprise. In this session, Jason Woodlee, Senior Director of Cloud Products at Datapipe, will discuss the technical details of designing and deploying a modern big data architecture on AWS, including application purpose and design, development environment and language overview, DevOps automation best practices, and continuous build and test frameworks.  Session sponsored by Datapipe. View Less
ISM212 - McDonald's Uses AWS to Launch Applications Quickly Around the Globe and Engage Customers
In a time when mobile digital media engagement is at 51% (compared to desktop engagement at 42%), restaurants are turning to innovative and interactive technologies to attract customers. Consistent with its motto, “good food, fast”, McDonald's turned to the cloud to reach always-on digital customers, enhance flexibility, and cut costs. For the past year, Datapipe has been working with McDonald's to develop the company's first born-in-the-cloud mobile application. Datapipe's AWS solution gives McDonald's the flexibility to quickly spin up instances as demand increases. It creates a standardized, repeatable process for deployment to markets around the globe. This flexibility - both geographically and in the infrastructure - gives McDonald's a hyperscalable environment (with the added benefit of cost containment) to take the restaurant into the modern age of consumer engagement. In this session, representatives from McDonald's and Datapipe will discuss the ongoing process of moving an iconic global enterprise into the 21st century. It looks in detail at the factors the company considered before moving to AWS, security concerns that needed to be addressed, and the long-term competitive advantage of using the AWS environment.  Session sponsored by Datapipe. View Less
ISM211 - Finally a Simpler Way to Directly Connect: Learn How More Organizations Can Now Directly Connect to AWS
Although the rich capabilities of cloud services are indisputable, secure and direct connections to these services remains just out of reach for most enterprises. The challenges center around complexity, specifically the need for specialized network engineering knowledge and the manual processes required to configure access to these services. This session introduces Console, the new enterprise software and interconnection platform that enables both network-to-network and enterprise-to-enterprise collaboration globally.  Session sponsored by Console. In this session, we discuss three specific use cases: enterprise, cloud services, and the data center. We present how Console's enterprise-grade software simply and securely connects the enterprise to mission-critical cloud services with a click of a button. Console provides automated layer 2 and layer 3 network configuration by leveraging open source technologies such as the CloudRouter Project and OpenDaylight. For the first time, enterprises can instantly obtain an Autonomous System Number (ASN) and auto-configure BGP for immediate direct interconnection. Its point-and-click interface directly connects enterprises to business-critical cloud resources like AWS. View Less
ISM209 - Acceleration of AWS Enterprise Adoption in GE: Migrating at Scale
After GE Oil and Gas created an aggressive strategy to migrate 100% of its application portfolio to public cloud providers, in just 18 months, more than 250 applications had been migrated to AWS. In one week alone, 27 applications went live in the AWS cloud. In partnership with Sogeti, this session will focus on what drove this Fortune 10 company's rapid migration to the cloud. Using Agile methodologies, the team focused on automation and self-service functionality; reduced outages by 98%; enhanced user experience; and delivered significant ROI. Topics will include application portfolio discovery; refactoring; creative use of native AWS services; integration of enterprise services and processes; and impact to operations in the cloud.  Session sponsored by CapGemini. View Less
ISM208 - The Science of Saving with AWS Reserved Instances
As your infrastructure grows, managing your portfolio of Reserved Instances can present new challenges. You'll need the right tools, metrics, and strategies in place to make sure you're maximizing coverage and minimizing the risk of those Reserved Instances going unused. In this session, you'll learn how scaled organizations have optimized their portfolios of Reserved Instances to cover most of their infrastructure. Attendees will walk away with strategies and tools for choosing Reserved Instances, making sure they get used, and showing the real impact on the company's AWS bill. Topics include choosing the right Reserved Instances to buy and modify; centralizing and streamlining the buying process; and tracking key metrics to show ROI.  Session sponsored by Cloudability. View Less
ISM207 - The Lean Enterprise: How the Principles of Lean Are Transforming Corporate Innovation
Cloud computing coupled with the emergence of lean principles in the field of innovation has transformed the corporate landscape. In this session, we will explore how corporates can respond to the emerging threat of startups and develop an innovation capability. This session will focus on real-world examples and address how organizations need to re-think traditional processes and governance practices if they are to thrive in the digital age. Conor McNamara, AWS Enterprise Strategy Lead for APAC & Joanne Molesky, co-author of the best-selling Lean Enterprise book will share their experiences from working with corporates who have embarked on this journey.   View Less
ISM206 - Modern IT Governance Through Transparency and Automation
As information technology increasingly becomes strategic to more enterprises and government agencies, and as the threat landscape evolves and becomes more challenging, governance, risk management, and compliance (GRC) increasingly become c-suite issues. In this session, we examine how the AWS cloud platform, through APIs and automation, enables advances and the implementation of best practices in governance and compliance. Learn how AWS can help senior leadership confidently answer key governance questions, such as: What do I have? How it is performing? Who controls it? Is it secure and compliant? Are we using the right processes and protections when we make changes? What is it costing me? View Less
ISM205 - A Framework for IT and Business Transformation
When customers think about moving to the cloud, one of their first considerations is cost. AWS helps lower customer costs through its “pay only for what you use” pricing model. In this session, we explain our TCO analysis methodology and explore the financial considerations of owning and operating a traditional data center or managed hosting provider compared with using AWS services. Customers also share their processes for developing the right cost savings and optimization model. View Less
ISM204 - Going All In with AWS: Customer Stories
Customers across the public sector are going all in with the AWS cloud. This panel features a range of customers who share their journey to the cloud and provide insight into their decision to move all in, the value they've seen, and the impact to their missions. View Less
ISM203 - Enterprise Cloud Adoption Strategies in Higher Education
Many large research universities now have cloud projects for almost every aspect of their enterprises as they move core student registration, finance, and HR applications to AWS. In this session, university executives report on their efforts and share their approaches to vision, strategy, culture, education, staffing, and technology. You receive practical advice about how to begin the journey to adoption, and learn about frameworks that can help you make decisions in your own educational environment. View Less
ISM202 - Sony Pictures' Rapid Recovery Solution for Disaster Recovery and Business Continuity Using Cloud Services
This session will discuss the solution used by Sony Pictures Entertainment to achieve rapid business continuity in digital media delivery and secure IT services. The combination of AWS infrastructure, Amazon Workspaces, and Aspera application software allowed Sony Pictures Entertainment to restore file transfer business services in less than one day and give business users and administrators secure access to infrastructure. Details include: An overview of the software and AWS infrastructure architecture used on day one and through expansion of the service; statistics for media transfer volumes and delivery times achieved; use cases for VDI secure access and associated controls; an overview of the longer-term hybrid architecture using the cloud solution as a cost-effective disaster recovery/secondary complement to Sony's on-premise capabilities; and business benefits, practical challenges, and best practices learned in the process. View Less
ISM201 - Preparing for Migration: Developing a Roadmap to AWS for 7,700 Systems and 5 Global Data Centers
A major communications company, home to some of the world's premier entertainment brands, evaluated both AWS and other cloud providers in preparation for a migration from its five global data centers to the cloud. After selecting AWS, the company worked with AWS Premier Partner 2nd Watch to assess over 7,700 systems that stretched across all five global data centers in order to prepare for the migration and create a roadmap to AWS. Learn about the vendor selection process, what it learned during its Cloud Readiness Assessment, and how it plans to move forward with the migration. View Less
WRK309 - Scaling Native Cross-Platform Mobile Apps with C#, Xamarin, and AWS
Xamarin enables C# developers to become native iOS, Android, and Windows mobile app developers overnight. Every great front-end mobile client needs a great backend service to power it, and that backend is AWS. The AWS Xamarin Mobile Services SDK enables these mobile apps to be instantly connected to AWS and take advantage of all the features you love such including Cloud Storage, AWS Lambda, Cloud NoSQL Database, and more. In addition to allowing you write your iOS and Android apps in C#, Xamarin lets you reuse existing .NET libraries and share your business logic across iOS, Android, and Windows apps. This means with Xamarin and AWS Xamarin Mobile SDK you have one C# shared backend to build and maintain, drastically cutting down development costs and increasing time to market.  In this session, attendees will create iOS and Android mobile apps in Visual Studio with Xamarin and integrate them with the new AWS Mobile SDK for Xamarin. Prerequisites:  As an option, attendees may follow along if they choose with their own laptop with software pre-reqs loaded (see below).  Optional: Mobile device. Prerequisites for Windows laptop developer: http://bit.ly/1JnueQo Prerequisites for Mac laptop developer: http://bit.ly/1L3V2ww Capacity: To encourage the interactive nature of this workshop, the session capacity is limited to approximately 70 attendees.  Attendance is based on a first come, first served basis once onsite.  Scheduling tools in the session catalog are for planning purposes only View Less
WRK308 - AWS + ASK: Teaching Amazon Echo New Skills
Alexa, the voice service that powers Amazon Echo, provides a set of built-in abilities, or skills, that enable customers to interact with devices in a more intuitive way using voice. Examples of these skills include the ability to play music, answer general questions, set an alarm or timer and more. We will also be taking a quick look at how the healthcare industry is integrating with the Alexa Skills Kit for new use cases. With the Alexa Skills Kit, you can easily build and add your own skills to Alexa. Customers can then access these new skills simply by asking Alexa a question or making a command. This workshop will be a walkthrough of the latest Alexa Skills Kit (ASK) and will teach you how to build your own skills for Alexa enabled devices, like the Amazon Echo. You will get hands on experience with an Amazon Echo device, the Alexa Skills Kit and AWS Lambda. You will also learn how to monitor your new skill using AWS CloudWatch and how to test your skill using both the Alexa Service Simulator, AWS Lambda Unit Tests and an Amazon Echo device  Prerequisites: Experience with Node JS, JavaScript, and AWS Lambda is a plus but not required. Participants should have an AWS account established and available for use during the workshop.  Capacity: To encourage the interactive nature of this workshop, the session capacity is limited to approximately 70 attendees.  Attendance is based on a first come, first served basis once onsite.  Scheduling tools in the session catalog are for planning purposes only. View Less
WRK202 - Rapid Mobile App Development on AWS
Mobile apps deliver efficient, cost-effective ways to interact with your end consumers.  AWS offers a number of services that help you build scalable and secure mobile apps including Amazon Cognito, AWS Lambda, Amazon SNS, and Amazon Mobile Analytics.  Come join us to learn how to quickly and easily add user sign-in, push notifications, user data sync, app analytics, cloud back-ends, and testing functionality to your app.  In this session, we will cover how AWS takes care of the undifferentiated heavy lifting of incorporating this functionality into your app so you can focus on building your app instead of managing these features individually.  We will start with a sample app and add each piece of functionality to show you how AWS services power these features for you.   Prerequisites: For an optimal experience, we recommend that attendees have basic knowledge of Objective-C. Participants should have an AWS account established and available for use during the workshop. Capacity: To encourage the interactive nature of this workshop, the session capacity is limited to approximately 70 attendees.  Attendance is based on a first come, first served basis once onsite.  Scheduling tools in the session catalog are for planning purposes only. View Less
MBL402 - Mobile Identity Management and Data Synchronization Using Amazon Cognito
Developing mobile apps can be complex and time-consuming. Learn how to simplify mobile identity management and data synchronization across devices. In addition, learn how to follow security best practices to give your app access to the resources it needs to provide a great user experience without hard-coding security credentials. We will cover how to easily and securely onboard users as anonymous guests using public login providers like Amazon, Facebook, Twitter, or your own user identity system. We are very excited to have Twitter representatives join us on stage for a deep dive on authenticating users with Twitter and Digits, which enables users to sign in with their phone numbers. View Less
MBL317 - NEW LAUNCH! Introducing AWS Mobile Hub: The Fastest Way to Build Mobile Apps on AWS
Mobile app development is complex and time-consuming. Learn how to rapidly deliver mobile apps with AWS Mobile Hub. We will demonstrate how AWS Mobile Hub abstracts the undifferentiated heavy lifting by providing a single, integrated experience for discovering, provisioning and configuring AWS cloud resources you need to build, test, and monitor usage of your mobile apps. View Less
MBL315 - How Etsy and IHS Are Improving The Quality of Their Mobile Apps With Automated Testing on AWS Device Farm
AWS Device Farm enables developers to deliver higher quality iOS, Android, and Fire OS apps by testing them against real phones and tablets in the AWS cloud. You can write and configure tests, run them in the cloud, and view detailed results that pinpoint bugs and performance problems. We are excited that Etsy and IHS will join us to discuss and take your questions about their mobile quality strategy and how they are using AWS Device Farm to enable that. View Less
MBL314 - Building World-Class, Cloud-Connected Products: How Sonos Leverages Amazon Kinesis
Sonos is a smart system of hi-fi wireless speakers and audio components. It unites your digital music collection in one app that you control from any device. Sonos leverages the Amazon Kinesis stream-processing platform to run near real-time streaming analytics on device data logs from connected Sonos hi-fi audio equipment. It analyzes usage, performance, quality logs, and other data feeds collected from Sonos-connected devices in near real-time to better understand its customer experience. In this session, Sonos will focus on the design and architecture considerations that drove their selection of AWS services for their platform, diving deep on Amazon Kinesis and Amazon DynamoDB. They will discuss architecture tradeoffs, such as Kinesis vs. Kafka and using its device data to gain some insights that differentiate Sonos in the music industry. View Less
MBL313 - NEW LAUNCH! AWS IoT Deep Dive: Understanding Hardware Kits, Devices SDKs, Protocols and More
AWS IoT is a new managed service that enables Internet-connected things (sensors, actuators, devices, and applications) to easily and securely interact with each other and the cloud. We have partnered with several hardware manufacturers to make it super easy for you to build your next dream machine. In this session, you will see how you can connect a real device to AWS IoT and accelerate your prototype development using Device SDKs. We will cover major hardware platforms from Arduino, Marvell, Dragonboard and MediaTek, protocols like MQTT/HTTP, various starter kits available so you can get started quickly..  View Less
MBL312 - NEW LAUNCH! AWS IoT Deep Dive: Programming the Physical World with Shadows and Rules
AWS IoT is a new managed service that enables Internet-connected things (sensors, actuators, devices, and applications) to easily and securely interact with each other and the cloud. As an IoT developer, you would like to interact with the devices and information from these devices using applications. With AWS IoT topic-based rules and built-in integrations, you can route data from any device to AWS service like DynamoDB, Lambda etc and interact with the devices using topics. With AWS IoT Thing shadows, you can interact with the device using applications. Let's dive deep on how we can define the rules and also retrieve the last known and desired state of device using a device shadow in the cloud and leverage the true power of AWS IoT View Less
MBL311 - NEW LAUNCH! AWS IoT Deep Dive: Securely Building, Provisioning, and Using Things with AWS IoT
AWS IoT is a new managed service that enables Internet-connected things (sensors, actuators, devices, and applications) to easily and securely interact with each other and the cloud. This talk will introduce the security and access control mechanisms used by AWS IoT. These mechanisms can be used to not only securely build and provision devices, but also to integrate devices with other AWS services. This allows you to build interesting, meaningful applications while owning little to no infrastructure. View Less
MBL310 - Alexa Voice Service Under the Hood
Alexa is the speech processing and personal assistant technology behind Amazon Echo. Speech-based user interfaces represent one of the next major disruptions in computing and the Alexa Voice Service (AVS) provides you with an opportunity to take advantage of this new form of interaction.  In this session, we'll walk through the recently-released AVS API by building a voice-enabled application and then go behind the scenes with Alexa, diving into the architecture and unique technical challenges faced during development. View Less
MBL309 - Analyze Mobile App Data and Build Predictive Applications
Amazon Mobile Analytics helps you track key trends such as active users, revenue, retention, and behavioral insights. In this session, you will learn how to make the most of your mobile app data for better business decisions. We will cover out-of-the-box dashboards, how to conduct custom analysis and visualize data, and how to build predictive applications to influence user engagement and monetization. Who Should Attend: Mobile app and game developers, product managers, data analysts, and business intelligence engineers View Less
MBL308 - Extending Alexa's Built-in Skills - See How Capital One Did It
Alexa, the voice service that powers Echo, provides a set of built-in abilities, or skills, that enable customers to interact with devices in a more intuitive way using voice. In this session we'll provide best practices on how to create a compelling voice experience leveraging Alexa's built-in skills. Scott Totman, VP of Mobile and Innovation at Capital One, will describe what they learned building their first voice experience, including how they mapped utterances to intents and optimized it for spoken language understanding. View Less
MBL307 - Scalable Messaging Architectures: How Mobile Businesses and Enterprises Use Amazon SNS to Power Their Messaging Needs
Does your business need a scalable messaging solution to drive user engagement or enable communication across your service-tiers? Join us to learn how Amazon SNS can be used to send messages at scale to destinations such as mobile apps, desktop apps, HTTP endpoints, Amazon SQS queues, email addresses, and AWS Lambda functions. Additionally, we will discuss how customers are using Amazon SNS in conjunction with other AWS services to address business needs ranging from targeted mobile push notifications to messaging bus fabrics for server-less backends. We are also excited that Easy Taxi and Earth Networks will join us and share how SNS has helped them address their business needs. View Less
MBL305 - You Have Data from the Devices, Now What?: Getting the Value of the IoT
We are collecting tons of sensor data from billions of devices. How do you get the value from your IoT data sources? In this session, we will explore different strategies for collecting and ingesting data, understanding its frequency, and leveraging the potential of the cloud to analyze and predict trends and behavior to get most out of your deployed devices. View Less
MBL303-APAC - Build Mobile Apps for IoT Devices and IoT Apps for Mobile Devices (APAC track)
Whether you are creating a mobile app that controls an IoT device (such as a wearable) or an IoT device that uses the mobile phone as the relay/hub to connect to the cloud, there are various design patterns to consider. In this session, we will focus on use cases and architectures for mobile phone and IoT-connected products that leverage proximal network protocols, Wi-Fi, or cellular to connect to the cloud for high-velocity and low-velocity telemetry or command and control. This is a repeat session that will be translated simultaneously into Japanese, Chinese, and Korean. View Less
MBL303 - Build Mobile Apps for IoT Devices and IoT Apps for Mobile Devices
Whether you are creating a mobile app that controls an IoT device (such as a wearable) or an IoT device that uses the mobile phone as the relay/hub to connect to the cloud, there are various design patterns to consider. In this session, we will focus on use cases and architectures for mobile phone and IoT-connected products that leverage proximal network protocols, Wi-Fi, or cellular to connect to the cloud for high-velocity and low-velocity telemetry or command and control. View Less
MBL302 - Building Scalable, Serverless Mobile and Internet of Things Back Ends
AWS Lambda is a compute service that runs your code in response to events and automatically manages the compute resources for you. Together with Amazon Cognito, Amazon SNS push notifications, and Amazon DynamoDB, AWS Lambda is a powerful tool to build a highly scalable back end for your mobile or IoT applications. This session will take a practical approach to developing real-world IoT and mobile applications with AWS in which the back end is serverless and can scale virtually unlimited users without any infrastructure or servers to manage. This session is for those who want to get started quickly. It includes a review of key concepts and how the AWS SDKs make it easy to create powerful applications for an always-on world that connects beyond the desktop. View Less
MBL301 - Voice-Enable All the Things: Creating Voice Experiences Using Amazon Alexa
Alexa is the speech and personal assistant technology behind Amazon Echo. Today you can use Alexa to listen to music, play games, check traffic and weather, control your household devices such as Philips Hue and Belkin WeMo, and lots more. Alexa offers a full-featured set of APIs and SDKs that you can use to teach her new skills and add her into devices and applications of your own. In this talk, intended for software and hardware developers interested in voice control, home automation, and personal assistant technology, we will walk through the development of a new Alexa skill and incorporate it into a consumer-facing device. View Less
MBL205 - NEW LAUNCH! Everything You Want to Know About AWS IoT
AWS IoT is a new managed service that enables Internet-connected things (sensors, actuators, devices, and applications) to easily and securely interact with each other and the cloud. In this session, we will discuss how constrained devices can leverage AWS IoT to send data to the cloud and receive commands back to the device from the cloud using protocol of their choice. We will discuss how devices can connect securely connect using MQTT, HTTP protocols and how can developers and businesses leverage several features of AWS IoT Rules Engine, Thing Shadow to build a real connected product. You don't want to miss this session if you are a maker or manufacturer of a connected device. We have a cool giveaway for you at the end of the session! View Less
MBL204 - Connecting the Unconnected - State of The Union - Internet of Things Powered by AWS
Why does connecting your physical devices to the cloud create more value for the user? How can connectivity enhance user experience? Why does connecting your things enhance your business model? In this session, Kyle Roche, GM of AWS IoT, will discuss the power of connecting your devices to the cloud and share AWS vision and latest products and features. Kyle provides an overview of real customer use cases and shares trends we are seeing among IoT customers. He will also bring some key customers on stage to share their experiences. View Less
MBL203 - From Drones to Cars: Connecting the Devices in Motion to the Cloud
Whether you are an automobile manufacturer, dispatch service, or drone manufacturer, your world is getting smarter. AWS provides all the building blocks required to build next-generation, Internet-connected devices that are in motion. In this session, we will share some best practices and architectural patterns device manufacturers can leverage for any connected device that is in motion to reliably and securely connect to AWS. View Less
MBL202 - Mobile State of the Union: Mobile Apps Powered by AWS
Marco Argenti, Vice President of AWS Mobile, will kick off the Mobile track and share our vision and the latest products and features we have launched this year. He will cover customer trends and even bring some key mobile customers on stage to share their experiences. View Less
NET409 - Movin' On Up to Amazon VPC: How Twilio Migrated Its Services from EC2-Classic to EC2-VPC
Amazon Virtual Private Cloud (Amazon VPC) has many obvious benefits. For example, you can use Amazon VPC to define a virtual network in your own logically isolated area within the AWS cloud, and launch your EC2 instances into a VPC. But how can you take advantage of the EC2-VPC platform if your services and infrastructure are already deployed in the EC2-Classic platform? In this deep-dive session, learn how to safely and reliably migrate from EC2-Classic to EC2-VPC with zero downtime. We show you how Twilio approached the problem of a VPC migration, or what we internally called the “Moving Datacenters Project.” We discuss the technologies and tools (both internal and external) we used to complete the migration, the infrastructure we built along the way, and the lessons we learned.  Session sponsored by Twilio. View Less
NET406 - Deep Dive: AWS Direct Connect and VPNs
As enterprises move to the cloud, robust connectivity is often an early consideration. AWS Direct Connect provides a more consistent network experience for accessing your AWS resources, typically with greater bandwidth and reduced network costs. This session dives deep into the features of AWS Direct Connect and VPNs. We discuss deployment architectures and demonstrate the process from start to finish. We'll show you how to configure public and private virtual interfaces, configure routers, use VPN backup, and provide secure communication between sites by using the AWS VPN CloudHub. View Less
NET405 - Snowstorm Got You Trapped at Home? Build a Remote Access VPN Solution on AWS
What if weather or any other major event prevents a large number of your users from coming into the office? Does your VPN or remote connectivity solution scale?   Deploying solutions in AWS gives you access to agility, cost savings, elasticity, breadth of functionality, and the ability to deploy globally in minutes. With access to these benefits through the AWS platform, administrators can launch global, scalable and resilient VPN solutions to support your business at a moments notice. In this session, learn how to build a flexible, elastic, highly secure VPN infrastructure by using Amazon Route 53, Amazon EC2, Auto Scaling, and 3rd party solutions to allow hundreds or thousands of users to work remotely as soon as the first snowflakes begin to fall.  To attend this session it is suggested that attendees have a working knowledge of VPC, EC2, general networking and an understanding of routing protocols. View Less
NET404 - Making Every Packet Count
Many applications are network I/O bound, including common database-based applications and service-based architectures. But operating systems and applications are often untuned to deliver high performance. This session uncovers hidden issues that lead to low network performance, and shows you how to overcome them to obtain the best network performance possible. View Less
NET403 - Another Day, Another Billion Packets
In this session, we walk through the Amazon VPC network presentation and describe the problems we were trying to solve when we created it. Next, we walk through how these problems are traditionally solved, and why those solutions are not scalable, inexpensive, or secure enough for AWS. Finally, we provide an overview of the solution that we've implemented and discuss some of the unique mechanisms that we use to ensure customer isolation, get packets into and out of the network, and support new features like VPC endpoints. View Less
NET308 - Consolidating DNS Data in the Cloud with Amazon Route 53
In this session, we show you how to use Amazon Route 53 to consolidate your DNS data and manage it centrally. Learn how to use Amazon Route 53 for public DNS and for private DNS in VPC, and also learn how to combine Amazon Route 53 private DNS with your own DNS infrastructure. View Less
NET307 - Pinterest: The road from EC2-Classic to EC2-VPC
Pinterest is rolling out a phased platform migration from EC2-Classic to EC2-VPC. We used ClassicLink to link our EC2-Classic instances to VPCs, and we applied AWS best practices to configure VPC subnets and security groups. In this session, we share the lessons we learned along the way, and we also show you how to create a migration strategy and track migration costs. View Less
NET303 - Network Slowing You Down? Optimizing Your Cloud Architecture by Looking at Network Strategy
In this session, explore three benefits of private, dedicated network connections to AWS. Learn how you can transport business-critical data directly from your data center, office, or colocation environment into and from AWS over dedicated network connections. Discover how to dynamically scale your bandwidth up to 300 percent, only paying for what you use, and how to use dynamic scaling to speed up backups, temporary or scheduled workloads, moving from test to live production, and new product launches. Also, learn how to use private network connectivity to help build hybrid environments in situations where security and compliance are critical. Hybrid environments let you extend your private on-premises infrastructure with the elasticity and economic benefits of AWS.  Session sponsored by Level 3. View Less
NET302 - Delivering a DBaaS Using Advanced AWS Networking
Delivering a managed database-as-a-service in a highly secure and simple way can be a challenging problem, especially when your customers have many different network and access requirements. We went through many iterations trying to find a model that was easy to support, but also gave our customers control and visibility. In this session, we explore the incredibly flexible AWS networking solutions that we have used to deliver our services to customers with wildly different architectures. This is an advanced session for those who want deliver services into complex or divergent network architectures, while still maintaining control of the infrastructure that your services are deployed on. View Less
NET301 - NextGen Networking: New Capabilities for Amazon Virtual Private Cloud
Amazon's Virtual Private Cloud (Amazon VPC) continues to evolve with new capabilities and enhancements. These features give you increasingly greater isolation, control, and visibility at the all-important networking layer. In this session, we review some of the latest changes, discuss their value, and describe their use cases. View Less
NET208 - Enable and Secure Your Business Applications via the Hybrid Cloud on AWS
Learn how to enable and support data migrations in AWS and keep your business applications highly secure, whether you are migrating your IT infrastructure to the cloud, migrating your business applications to the cloud, or simply moving traffic on AWS between different Availability Zones. Our real-world use cases include securing your critical business applications in AWS by deploying vSRX as a perimeter firewall for VPC instances, and enabling secure transport and routing for hybrid cloud deployments using IPSec VPNs on vMX.  Session sponsored by Juniper Networks. View Less
NET202 - Cloud Connectivity Using Software-Defined Networking and Advanced API Technology
Do you need high performance, global connectivity for your growing business? Learn how you can leverage your existing investments with new software-defined networking technology to securely connect from anywhere in the world to your AWS cloud applications. Do you need to support multiple lines of business that connect to AWS? Discover how new software technology enables your lines of business to easily and quickly create virtual connections to AWS, resulting in increased agility and reduced costs. Is your business transforming to the hybrid cloud? Use Multiprotocol Label Switching (MPLS) networking to securely connect from your customer-owned data centers to your applications that run in the AWS cloud, avoiding the risks associated with the Internet. Session sponsored by AT&T. View Less
NET201 - Creating Your Virtual Data Center: VPC Fundamentals and Connectivity Options
In this session, we will walk through the fundamentals of Amazon Virtual Private Cloud (VPC). First, we will cover build-out and design fundamentals for VPC, including picking your IP space, subnetting, routing, security, NAT, and much more. We will then transition into different approaches and use cases for optionally connecting your VPC to your physical data center with VPN or AWS Direct Connect.  This mid-level architecture discussion is aimed at architects, network administrators, and technology decision-makers interested in understanding the building blocks AWS makes available with VPC and how you can connect this with your offices and current data center footprint. View Less
SEC403 - Timely Security Alerts and Analytics: Diving into AWS CloudTrail Events by Using Apache Spark on Amazon EMR
Do you want to analyze AWS CloudTrail events within minutes of them arriving in your Amazon S3 bucket? Would you like to learn how to run expressive queries over your CloudTrail logs? We will demonstrate Apache Spark and Apache Spark Streaming as two tools to analyze recent and historical security logs for your accounts. To do so, we will use Amazon Elastic MapReduce (EMR), your logs stored in S3, and Amazon SNS to generate alerts. With these tools at your fingertips, you will be the first to know about security events that require your attention, and you will be able to quickly identify and evaluate the relevant security log entries. View Less
SEC402 - Enterprise Cloud Security via DevSecOps 2.0
Running enterprise workloads with sensitive data in AWS is hard and requires an in-depth understanding about software-defined security risks. At re:Invent 2014, Intuit and AWS presented "Enterprise Cloud Security via DevSecOps" to help the community understand how to embrace AWS features and a software-defined security model. Since then, we've learned quite a bit more about running sensitive workloads in AWS. We've evaluated new security features, worked with vendors, and generally explored how to develop security-as-code skills. Come join Intuit and AWS to learn about second-year lessons and see how DevSecOps is evolving. We've built skills in security engineering, compliance operations, security science, and security operations to secure AWS-hosted applications. We will share stories and insights about DevSecOps experiments, and show you how to crawl, walk, and then run into the world of DevSecOps. View Less
SEC401 - Encryption Key Storage with AWS KMS at Okta
One of the biggest challenges in writing code that manages encrypted data is developing a secure model for obtaining keys and rotating them when an administrator leaves. AWS Key Management Service (KMS) changes the equation by offering key management as a service, enabling a number of security improvements over conventional key storage methods. Jon Todd will show how Okta uses the KMS API to secure a multi-region system serving thousands of customers. This talk is oriented toward developers looking to secure their applications and simplify key management. View Less
SEC326 - Security Science Using Big Data
AWS provides all sorts of security features and capabilities, and these features generate tons of data to be sifted and analyzed. In this session, hear what we are doing to support ingestion, processing, and storage of data at scale to support our Security Science and DevSecOps programs. We've had a lot of experience understanding what is and is not possible for crunching security data using big data environments. In fact, we've discovered it's much easier to develop the tools and processes necessary to support applications than you might think. View Less
SEC325 - Satisfy PCI Obligations While Continuing to Innovate
As an online payments provider, Stripe has always had a close relationship with PCI DSS. And as a partner to hundreds of thousands of online businesses, we take the security of our users' personal information very seriously. But as a fast-growing startup company where fast innovation is a key advantage, we also can't let PCI control us. In this session, we will discuss strategies we have used that both make us more secure and satisfy our PCI (and other) obligations, all without slowing down our ability to innovate. Though useful for PCI and other compliance obligations, these strategies can just as easily be applied to security problems across your organization. View Less
SEC324 - NEW LAUNCH! Introducing Amazon Inspector - Security Insight into Your Application Deployments
Amazon Inspector is a new service from AWS that identifies security issues in your application deployments. Use Inspector with your applications to assess your security posture and identify areas that can be improved. Inspector works with your Amazon EC2 instances to monitor activity in your applications and system. This session will cover getting started with Inspector, how to automate the process, how to manage and act on findings, and additional ways you can enhance your development and release lifecycle using Inspector. View Less
SEC323 - NEW LAUNCH! Securing Web Applications with AWS WAF
In this session, we will introduce you to the new AWS WAF service. We will show you how to use the service to block Amazon CloudFront requests that originate from IP addresses that you specify and block requests based on request content, such as header values or SQL queries. We will walk you through working code samples that automate security operations and demonstrate the flexibility of AWS WAF web ACLs. View Less
SEC321 - AWS for the Enterprise-Implementing Policy, Governance, and Security for Enterprise Workloads
CSC engineers will demonstrate enterprise policy, governance, and security products to deploy and manage enterprise and industry applications AWS.  We will demonstrate automated provisioning and management of big data platforms and industry specific enterprise applications with automatically provisioned secure network connectivity from the datacenter to AWS over layer 2 routed AT&T NetBond (provides AWS DirectConnect access) connection.  We will demonstrate how applications blueprinted on CSC's Agility Platform can be re-hosted on AWS in minutes or re-instantiated across multiple AWS regions.  CSC Cybersecurity will also demonstrate how CSC can provide agile & consumption based endpoint security for workloads in any cloud or virtual infrastructure, providing enterprise management and 24x7 monitoring of workload compliance, vulnerabilities, and potential threats. Session sponsored by CSC. View Less
SEC320 - AWS Security Beyond the Host: Leveraging the Power of AWS to Automate Security and Compliance
You've made the move to AWS and are now reaping the benefits of decreased costs and increased business agility. How can you reap those same benefits for your cloud security and compliance operations? As building cloud-native applications requires different skill sets, architectures, integrations, and processes, implementing effective, scalable, and robust security for the cloud requires rethinking everything from your security tools to your team culture.   Attend this session to learn how to start down the path toward security and compliance automation and hear how DevSecOps leaders such as Intuit and Capital One are using AWS, DevOps, and automation to transform their security operations. Session sponsored by evident.io View Less
SEC318 - AWS CloudTrail Deep Dive
Ever wondered how can you find out which user made a particular API call, when the call was made, and which resources were acted upon? In this session, you will learn how to turn on AWS CloudTrail for hundreds of AWS accounts in all AWS regions to ensure you have full visibility into API activity in all your AWS accounts. We will demonstrate how to use CloudTrail Lookup in the AWS Management Console to troubleshoot operational and security issues and how to use the AWS CLI or SDKs to integrate your applications with CloudTrail. We will also demonstrate how you can monitor for specific API activity by using Amazon CloudWatch and receive email notifications, when such activity occurs. Using CloudTrail Lookup and CloudWatch Alarms, you can take immediate action to quickly remediate any security or operational issues. We will also share best practices and ready-to-use scripts, and dive deep into new features that help you configure additional layers of security for CloudTrail log files. View Less
SEC316 - Harden Your Architecture with Security Incident Response Simulations (SIRS)
Using Security Incident Response Simulations (SIRS--also commonly called IR Game Days) regularly keeps your first responders in practice and ready to engage in real events. SIRS help you identify and close security gaps in your platform, and application layers then validate your ability to respond. In this session, we will share a straightforward method for conducting SIRS. Then AWS enterprise customers will take the stage to share their experience running joint SIRS with AWS on their AWS architectures. Learn about detection, containment, data preservation, security controls, and more. View Less
SEC315 - AWS Directory Service Deep Dive
AWS Directory Service enables you to create a new Active Directory domain in AWS with Simple AD or to connect your existing Active Directory domain with AD Connector. Learn how to use these offerings to domain join and enable single sign-on (SSO) to your Amazon EC2 Windows and Linux instances, set up federated access to the AWS Management Console, and use Amazon WorkSpaces, Amazon WorkDocs, and Amazon WorkMail. View Less
SEC314 - NEW LAUNCH! AWS Config/Config Rules: Use AWS Config Rules to Improve Governance over Configuration Changes to Your Resources
AWS Config enables you to discover what resources are used on AWS, understand how resources are configured and gives you unprecedented visibility into changes to configurations over time - all without disrupting end user productivity. With Config Rules, you can continuously evaluate whether changes to resources are compliant with policies. You can set up predefined rules, provided and managed by AWS, or author your own rules using Amazon Lambda, and these rules are evaluated whenever relevant resources are modified. You can use this visibility and control to assess and improve your security and compliance posture. We will dive deep into other new capabilities in AWS Config and cover how you can integrate with IT service management, configuration management, and other tools. In this session, we will look at: AWS Config Rules - how to create and use rules that govern configuration changes recorded by AWS Config. New capabilities in AWS Config - Usability changes, better controls and other enhancements Mechanisms to aggregate deep visibility across AWS to gain insights into your overall security and operational posture. This session is best suited for administrators, security-ops and developers with a focus on audit, security and compliance. View Less
SEC313 - Security and Compliance at Petabyte Scale: Lessons from the National Cancer Institute's Cancer Genomics Cloud Pilot
Delivering petabyte-scale computational resources to a large community of users while meeting stringent security and compliance requirements presents a host of technical challenges. Seven Bridges Genomics met and overcame them when building the Cancer Genomics Cloud Pilot (CGC) for the National Cancer Institute. The CGC helps users to solve massive computational problems involving multidimensional data, which include: running diverse analyses in a reproducible manner, collaborating with other researchers, and keeping personal data secure to comply with NIH regulations on controlled data sets. Seven Bridges will highlight the lessons learned along the way, as well as best practices for constructing secure and compliant platform services using Amazon S3, Amazon Glacier, AWS Identity and Access Management (IAM), Amazon VPC, and Amazon Route 53. View Less
SEC312 - Reliable Design and Deployment of Security and Compliance
No matter how you use AWS resources, you can design your AWS account to deliver a reliably secure and controlled environment. This session will focus on "Secure by Design" principles and show how you can configure the AWS environment to provide the reliable operation of security controls, such as: Organizational governance Asset inventory and control Logical access controls Operating system configuration Database security Applications security configurations This session will focus on using AWS security features to architect securing and auditing the architecture capabilities of AWS cloud services such as AWS Identity and Access Management (IAM), Amazon Elastic Compute Cloud (EC2), Amazon Elastic Block Storage (EBS), Amazon S3, Amazon Virtual Private Cloud (VPC), Amazon Machine Images (AMIs), and AWS CloudFormation templates. The session will include demonstrations with the governance perspective in mind and discuss how AWS technology can be used to create a secure and auditable environment. View Less
SEC310 - Splitting the Check on Compliance and Security: Keeping Developers and Auditors Happy in the Cloud
Often times, developers and auditors can be at odds. The agile, fast-moving environments that developers enjoy will typically give auditors heartburn. The more controlled and stable environments that auditors prefer to demonstrate and maintain compliance are traditionally not friendly to developers or innovation. We'll walk through how Netflix moved its PCI and SOX environments to the cloud and how we were able to leverage the benefits of the cloud and agile development to satisfy both auditors and developers. Topics covered will include shared responsibility, using compartmentalization and microservices for scope control, immutable infrastructure, and continuous security testing. View Less
SEC308 - Wrangling Security Events in the Cloud
Have you prepared your AWS environment for detecting and managing security-related events? Do you have all the incident response training and tools you need to rapidly respond to, recover from, and determine the root cause of security events in the cloud? Even if you have a team of incident response rock stars with an arsenal of automated data acquisition and computer forensics capabilities, there is likely a thing or two you will learn from several step-by-step demonstrations of wrangling various potential security events within an AWS environment, from detection to response to recovery to investigating root cause. At a minimum, show up to find out who to call and what to expect when you need assistance with applying your existing, already awesome incident response runbook to your AWS environment. View Less
SEC307 - A Progressive Journey Through AWS IAM Federation Options: From Roles to SAML to Custom Identity Brokers
AWS Identity and Access Management (IAM) offers a continuum of interfaces and configuration options that enables customers to integrate their unique organizational identity structure and operational processes to the AWS platform. In this session we will evaluate the progressive journey of federation options that most customers go through as they widen their integration with IAM. This will include best practices, lessons learned from the field, and examples of actual customer implementations, covering technologies such as SAML, LDAP, and custom identity brokers. View Less
SEC306 - Defending Against DDoS Attacks
In this session, we will address the current threat landscape, present DDoS attacks that we have seen on AWS, and discuss the methods and technologies we use to protect AWS services. You will leave this session with a better understanding of: DDoS attacks on AWS as well as the actual threats and volumes that we typically see. What AWS does to protect our services from these attacks. How this all relates to the AWS Shared Responsibility Model. View Less
SEC305 - How to Become an IAM Policy Ninja in 60 Minutes or Less
Are you interested in learning how to control access to your AWS resources? Have you ever wondered how to best scope down permissions to achieve least privilege permissions access control? If your answer to these questions is "yes," this session is for you. We will take an in-depth look at the AWS Identity and Access Management (IAM) policy language. We will start with the basics of the policy language and how to create and attach policies to IAM users, groups, and roles. As we dive deeper, we will explore policy variables, conditions, and other tools to help you author least privilege policies. Throughout the session, we will cover some common use cases, such as granting a user secure access to an Amazon S3 bucket or locking down access to Amazon EC2 instances. The demonstrations will use tools such as the policy editor and policy simulator to debug policies. View Less
SEC304 - Architecting for HIPAA Compliance on AWS
This session brings together the interests of engineering, compliance, and security as you align healthcare workloads to the controls in the HIPAA Security Rule. We'll discuss how to architect for HIPAA compliance using AWS, and introduce a number of new services added to the HIPAA program in 2015, such as Amazon Relational Database Service (RDS), Amazon DynamoDB, and Amazon Elastic MapReduce (EMR). You'll hear from customers who process and store Protected Health Information on AWS, and how they satisfied their compliance requirements while maintaining agility. This session helps security and compliance experts see what's technically possible on AWS, and how implementing the Technical Safeguards in the HIPAA Security Rule is simple and familiar. We map the Security Rule's Technical Safeguards to AWS features and design patterns to help developers, operations teams, and engineers speak the language of their security and compliance peers. View Less
SEC303-APAC - Architecting for End-to-End Security in the Enterprise (APAC track)
This session tells the story of how security-minded enterprises provide end-to-end protection of their sensitive data in AWS. Learn about the enterprise security architecture decisions made by Fortune 500 organizations during actual sensitive workload deployments as told by the AWS professional service security, risk, and compliance team members who lived them. In this technical walkthrough, we share lessons learned from the development of enterprise security strategy, security use-case development, end-to-end security architecture and service composition, security configuration decisions, and the creation of AWS security operations playbooks to support the architecture. This is a repeat session that will be translated simultaneously into Japanese, Chinese, and Korean. View Less
SEC303 - Architecting for End-to-End Security in the Enterprise
This session tells the story of how security-minded enterprises provide end-to-end protection of their sensitive data in AWS. Learn about the enterprise security architecture decisions made by Fortune 500 organizations during actual sensitive workload deployments as told by the AWS professional service security, risk, and compliance team members who lived them. In this technical walkthrough, we share lessons learned from the development of enterprise security strategy, security use-case development, end-to-end security architecture and service composition, security configuration decisions, and the creation of AWS security operations playbooks to support the architecture. View Less
SEC302 - IAM Best Practices to Live By
This session will cover AWS Identity and Access Management (IAM) best practices that help improve your security posture. We will cover how to manage users and their security credentials. We'll also explain why you should delete your root access keys-or at the very least, rotate them regularly. Using common use cases, we will demonstrate when to choose between using IAM users and IAM roles. Finally, we will explore how to set permissions to grant least privilege access control in one or more of your AWS accounts. View Less
SEC301 - Strategies for Protecting Data Using Encryption in AWS
Protecting sensitive data in the cloud typically requires encryption. Managing the keys used for encryption can be challenging as your sensitive data passes between services and applications. AWS offers several options for using encryption and managing keys to help simplify the protection of your data at rest. This session will help you understand which features are available and how to use them, with emphasis on AWS Key Management Service and AWS CloudHSM. Adobe Systems Incorporated will present their experience using AWS encryption services to solve data security needs. View Less
SEC205 - Learn How to Hackproof Your Cloud Using Native AWS Tools
The cloud requires us to rethink much of what we do to secure our applications. The idea of physical security morphs as infrastructure becomes virtualized by AWS APIs. In a new world of ephemeral, autoscaling infrastructure, you need to adapt your security architecture to meet both compliance and security threats. And AWS provides powerful tools that enable users to confidently overcome these challenges. In this session, we will discuss leveraging native AWS tools as we cover topics including: Minimizing attack vectors and surface area. Conducting perimeter assessments of your virtual private clouds (VPCs). Identifying internal vs. external threats. Monitoring threats. Reevaluating intrusion detection, activity monitoring, and vulnerability assessment in AWS. Session sponsored by CloudCheckr. View Less
SEC204 - AWS GovCloud (US) Not Just For Govies: Meeting Requirements for US-Only Access
For some organizations, all of the technical security features in the world can't address an underlying need to restrict physical access of resources to citizens within the United States. GovCloud (US) was established to meet the needs of the US federal government, but it is available for any organization facing the challenge of restricting access in this way. Learn about the features available in GovCloud (US), how to onboard your workloads, and the options for using GovCloud (US) as one of multiple regions. Also, hear from government and commercial customers about their experience using GovCloud (US).  View Less
SEC203 - Journey to Securing Time Inc's Move to the Cloud
Learn how Time Inc. met security requirements as they transitioned from their data centers to the AWS cloud. Colin Bodell, CTO from Time Inc. will start off this session by presenting Time's objective to move away from on-premise and co-location data centers to AWS and the cost savings that has been realized with this transition. Chris Nicodemo from Time Inc. and Derek Uzzle from Alert Logic will then share lessons learned in the journey to secure dozens of high volume media websites during the migration, and how it has enhanced overall security flexibility and scalability. They will also provide a deep dive on the solutions Time has leveraged for their enterprise security best practices, and show you how they were able to execute their security strategy.  Who should attend: InfoSec and IT management. Session sponsored by Alert Logic. View Less
SEC202 - If You Build It, They Will Come: Best Practices for Securely Leveraging the Cloud
Cloud adoption is driving digital business growth and enabling companies to shift to processes and practices that make innovation continual. As with any paradigm shift, cloud computing requires different rules and a different way of thinking. This presentation will highlight best practices to build and secure scalable systems in the cloud and capitalize on the cloud with confidence and clarity. In this session we will cover: Key market drivers and advantages for leveraging cloud architectures. Foundational design principles to guide strategy for securely leveraging the cloud. The “Defense in Depth” approach to building secure services in the cloud, whether it's private, public, or hybrid. Real-world customer insights from organizations who have successfully adopted the "Defense in Depth" approach. Session sponsored by Sumo Logic. View Less
SEC201 - AWS Security State of the Union
Security must be at the forefront for any online business. At AWS, security is priority number one. Stephen Schmidt, Vice President and Chief Information Security Officer, shares his insights into cloud security and how AWS meets customers' demanding security and compliance requirements-and in many cases helps them improve their security posture. Stephen, with his background with the FBI and his work with AWS customers in the government, space exploration, research, and financial services organizations, shares an industry perspective that's unique and invaluable for today's IT decision makers. View Less
SPOT309 - Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
An 80-year old startup, NASA's Jet Propulsion Laboratory continues to be a driving source of innovation in American technology. The past decade of this trek included NASA's expedition into cloud computing, seeing the delivery of cloud building blocks, initial applications, and a boom of higher order opportunities. These successes have begun to feed forward into enterprises and growing startups, while NASA continues to blaze a trail ahead. This talk by three of NASA's cloud explorers discusses what made this journey possible, how it was executed, and what lies ahead. In this session, Tom Soderstrom, chief technology and innovation officer for IT at NASA JPL, talks about how NASA thinks about innovation, the role of cloud computing in the innovation cycle, and how NASA took cloud computing from prototyping to playing a mission-critical role across the organization. You also hear from two influential JPL alumni who spread-and amplified-the approach. Come and hear the impact that cloud computing is having on science, discovery, and innovation, how missions at NASA are using cloud computing today, and where it is going in the future. View Less
SPOT304 - Faster, Cheaper, Safer Products with AWS: Adrian Cockcroft Shares Experiences Helping Customers Move to the Cloud
Adrian Cockcroft is well-known for leading the Netflix architecture migration to AWS and also the Netflix Open Source Software (NetflixOSS) platform. For the last two years he's been working as a technology fellow at Battery Ventures, where he has helped portfolio companies with their own migration to AWS, with adoption of NetflixOSS tools, and with optimization of their architectures to reduce costs. He's also consulted with large enterprises that are moving to the cloud, DevOps, and microservices. This talk will summarize his recent experiences across the portfolio and with large organization end users as they optimize for faster, cheaper, and safer products using AWS. View Less
SPOT303 - Security Operations at Massive Scale
This session, co-led by Steve Schmidt, AWS Chief Information Security Officer, and George Stathakopoulos, Amazon.com VP of Information Security, gives a unique view of how a global provider and customer work together to deliver security on a massive scale. Steve and George will show some of the innovations that help their teams deliver world-class security operations at scale. This session is not moderated but is a conversation between two world-class security experts with differing responsibilities for the Amazon.com and Amazon Web Services global security posture. Join this session and walk away with a deeper understanding of the underlying security innovations powering the cloud and how you can enable them in your business. View Less
SPOT302 - Availability: The New Kind of Innovator's Dilemma
Successful companies, while focusing on their current customers' needs, often fail to embrace disruptive technologies and business models. This phenomenon, known as the "Innovator's Dilemma," eventually leads to many companies' downfall and is especially relevant in the fast-paced world of online services. In order to protect its leading position and grow its share of the highly competitive global digital streaming market, Netflix has to continuously increase the pace of innovation by constantly refining recommendation algorithms and adding new product features, while maintaining a high level of service uptime. The Netflix streaming platform consists of hundreds of microservices that are constantly evolving, and even the smallest production change may cause a cascading failure that can bring the entire service down. We face a new kind of Innovator's Dilemma, where product changes may not only disrupt the business model but also cause production outages that deny customers service access. This talk will describe various architectural, operational and organizational changes adopted by Netflix in order to reconcile rapid innovation with service availability. View Less
SPOT301 - AWS Innovation at Scale
In this session, Vice President of AWS Infrastructure Jerry Hunter gives an insider view of some of the innovations that help make the AWS cloud unique. Jerry will show examples of data center, power, and networking innovations used across the AWS platform. Join this session and walk away with a deeper understanding of the underlying innovations powering the cloud. View Less
SPOT210 - Zynga's Journey (Back) to the AWS Cloud
Zynga, a leading developer of social games with popular titles such as FarmVille, Zynga Poker, Words With Friends, and Hit It Rich! Slots, was an early AWS customer that decided to move most of its infrastructure off AWS in 2011 to build its own private cloud and data centers. With changes to its business over the years-particularly a transition to mobile games-and an ever-increasing focus on analytics, Zynga determined that it would stop running its own infrastructure and migrate all of its workloads back to AWS by the end of 2015, gaining agility, infrastructure efficiency, and a reduction in their overall operating cost. In this session, learn from Dorion Carroll, chief information officer (CIO) for Zynga, as he discusses the specific reasons why Zynga decided to move back to AWS as well as his approach to Zynga's migration plan. View Less
SPOT209 - Raising the Bar on Video Streaming Quality Using AWS: Amazon Video Case Study
Delivering streaming video at scale with high availability, security, and performance is a challenge for many large organizations. In this session, learn how Amazon Video was able to build one of the world's largest video delivery platforms using multiple AWS services such as Amazon S3, Amazon EC2, Amazon CloudFront, Amazon Redshift, and Amazon Elastic MapReduce. We walk you through a comprehensive architecture and workflow for how Amazon Video is able to process and deliver video content to more than a million different devices every day. We also discuss how Amazon Video and CloudFront worked together to build the next generation of CloudFront edge locations optimized for long-tail and high bit-rate video delivery. View Less
SPOT208 - Supporting Diversity: How to Sponsor a Diversity Circle in a Technical Workplace
Diversity in the technical workforce is a valuable asset for all companies, because it encourages different types of thinking and taps into the full potential of your team. Come learn from one AWS organization how a fast-moving, fast-growing team has put in place a "diversity circle" for personal and professional development. This program provides a peer mentoring group that builds skills and establishes informal networking support. The host and active participants of this two-year program will share tips and best practices for running a diversity peer mentoring group that spans engineering, product management, and operations. View Less
SPOT207 - Women in Technology Panel Discussion
Please join us for a panel discussion moderated by Teresa Carlson, vice president of the Amazon Web Services public sector. We'll discuss "The Advantage of Diversity" with top female executives from around the industry. View Less
SPOT205 - Five Lessons for Managing Massive IT Transformation Projects
Choice Hotels is undertaking a multiyear, $20 million project to recreate our core business engines on AWS. In trying to approach this complex undertaking, we determined that the project itself is a system too. You can apply principles of good architecture and design work in how you approach the project structure and management. Come to this talk by Choice Hotels' CTO to learn five key lessons and 20 concrete takeaways that you can implement today to help your AWS projects succeed. View Less
SPOT204 - Startup Insights from a Venture Capitalist's Perspective
Join this high-powered panel of venture capitalists as they share insights and observations about the global startup ecosystem. Panelists will each share the most significant insight they've gained in the past 12 months and what development they believe will have the most impact in the coming year. You'll leave this session with meaningful insights that you can apply to real-world scenarios, increasing your startup's chances of success. View Less
SPOT203 - Fourth Annual Startup Launches, Hosted by Werner Vogels
Watch four AWS-powered startups launch their companies on stage! Amazon.com CTO Dr. Werner Vogels hosts this session, which will showcase five disruptive new startups that have built solutions using the AWS cloud. Each startup will make a never-before-shared launch announcement, which will include a special offer for audience attendees. Whether you're a startup, entrepreneur, or tech enthusiast, you won't want to miss these startup launches. A happy hour with food, drinks, and networking will immediately follow the launches. View Less
SPOT202 - CTO-to-CTO Fireside Chat with Dr. Werner Vogels
Amazon.com CTO Dr. Werner Vogels gets into the mindsets of technical leaders behind some of the most progressive and innovative startups in the world. Learn what happens behind the scenes, how pivotal technology and AWS infrastructure decisions are made, and the thought process that goes into creating products and services which disrupt and reshape the global tech scene. View Less
SPOT201 - The Startup Scene in 2016: a Visionary Panel Hosted by Dr. Werner Vogels
Join this diverse panel of technology experts as they discuss emerging trends all startups should be aware of in a dialogue moderated by Amazon.com CTO Dr. Werner Vogels. The group gives a peek into the future by discussing how local governments, microeconomic trends, evolving accelerator programs, new-school funding habits, and the AWS cloud are influencing the ever-shifting startup scene. View Less
STG406 - Using S3 to Build and Scale an Unlimited Storage Service for Millions of Consumers
Amazon Cloud Drive's plans to provide a low cost, unlimited storage service presented a major engineering challenge. In this session, you learn how the Amazon Cloud Drive team designed and optimized the storage back-end, Amazon S3, to handle millions of users while containing infrastructure costs. In this session, the lead engineers share details of how they built the service for massive scale, and the regular steps they take to increase performance and efficiency. They also describe proven techniques for scaling and optimization, learned from experience. View Less
STG403 - Amazon EBS: Designing for Performance
Amazon Elastic Block Store (Amazon EBS) provides persistent block level storage volumes for use with Amazon EC2 instances. In this technical session, we discuss how to maximize Amazon EBS performance, with a special eye toward low-latency, high-throughput applications like databases. We explain how to monitor your application and share real-world examples. View Less
STG402 - Amazon EBS Deep Dive
Amazon Elastic Block Store (Amazon EBS) provides persistent block level storage volumes for use with Amazon EC2 instances. In this technical session, we conduct a detailed analysis of the differences among the three types of Amazon EBS block storage: General Purpose (SSD), Provisioned IOPS (SSD), and Magnetic. We discuss how to maximize Amazon EBS performance, with a special eye towards low-latency, high-throughput applications like databases. We discuss Amazon EBS encryption and share best practices for Amazon EBS snapshot management. Throughout, we share tips for success. View Less
STG401 - Amazon S3 Deep Dive and Best Practices
Come learn about new and existing Amazon S3 features that can help you better protect your data, save on cost, and improve usability, security, and performance. We will cover a wide variety of Amazon S3 features and go into depth on several newer features with configuration and code snippets, so you can apply the learnings on your object storage workloads. View Less
STG312 - Amazon Glacier Deep Dive: Cold Data Storage in AWS
This session explores some of the key features of Amazon Glacier, including security, durability, and configuration for storing compliance and regulatory data. It covers best practices for managing your cold data, including ingest, retrieval, and security controls. Other topics include: how to optimize storage, upload, and retrieval costs; how to identify the most applicable workloads; and recommended optimizations based on a few sample use cases from a number of industry verticals. View Less
STG311 - AWS Storage Gateway: Simple, Secure, Cost-Effective Backup and Archive in the Cloud
AWS Storage Gateway is a service that connects an on-premises software appliance with AWS storage. It simplifies the adoption of cloud-based storage within on-premises environments, giving customers a secure, reliable, and cost-effective alternative to local storage. In this session, we take a detailed look at how to use Storage Gateway to backup and archive on-premises data. We discuss the three types of storage and how to select the right type for your environment. We walk through setup and configuration of the on-premises gateway appliance, data restoration, and daily management, such as monitoring performance and managing storage. The session is intended for customers who perform on-premises backup and archive today, and want to learn how to include cloud storage in their environment. View Less
STG308 - Case Studies: How Electronic Arts, State of Texas, and H3 Biomedicine Use AWS Storage Services to Extend Capabilities and Protect Data
In this session, learn how enterprise customers use AWS storage services to address different storage requirements. Learn how Electronic Arts and H3 Biomedicine manage their data flow from on-premises systems to the cloud, giving them a centralized build system and storage flexibility by leveraging enterprise storage gateways. The State of Texas uses AWS and partner solutions to modernize and secure their office file services, and backup and recovery systems, achieving dramatic savings and productivity gains without compromising IT efficiency. View Less
STG307 - Go Beyond Cloud Backup: How to Enable Disaster Recovery and Migrate to AWS
CommVault provides a single software platform to ensure disaster recovery, archive, and long-term retention of your workloads and data in AWS. This session explores best practices and key use cases to help you build your data management strategy as you migrate into AWS including: send recovery copies directly to Amazon S3 and recover them into Amazon EC2 for disaster recovery; reduce on-premises storage footprint by sending retention and recovery copies to Amazon S3, and archive and compliance data to Amazon Glacier; provision and manage workloads in the AWS cloud; and protect AWS workloads by directly leveraging EBS snapshots and sending those snapshots to Amazon S3 storage for retention and recovery.  Session sponsored by commVault. View Less
STG306 - EFS Update
In this session we will review the world's first cloud-scale network attached file system and its targeted use cases. Session attendees will learn about EFS's benefits, how to identify applications that are appropriate for use with EFS, and details about its performance and security models. The target audience is file system administrators, application developers, and application owners that operate or build file-based applications. View Less
STG304 - Deploying a Disaster Recovery Site on AWS: Minimal Cost with Maximum Efficiency
In the event of a disaster, you need to be able to recover lost data quickly to ensure business continuity. For critical applications, keeping your time to recover and data loss to a minimum as well as optimizing your overall capital expense can be challenging. This session presents AWS features and services along with Disaster Recovery architectures that you can leverage when building highly available and disaster resilient applications. We will provide recommendations on how to improve your Disaster Recovery plan and discuss example scenarios showing how to recover from a disaster. View Less
STG206 - Using Amazon CloudFront to Improve the Performance, Availability, and Cacheability of Your Website or Application
Amazon CloudFront, the AWS Content Delivery Network (CDN), can be used to deliver your entire website, including dynamic, static, streaming, and interactive content using a global network of edge locations.   In this technical session, learn directly from CloudFront engineers on how you can improve the performance, availability, and cacheability of your website or application. Several topics will be explored in a series of flash talks including: Best Practices for Setting up Your Origin, How to Gain Visibility into Your Distribution Using Real-Time Metrics & Analytics, How to Improve Cacheability,  and How to Test Your Configuration. This session assumes a working knowledge of CDN. View Less
STG205 - Secure Content Delivery Using Amazon CloudFront
Whether you are building an e-commerce site or a business application, security is a key consideration when architecting your website or application. In this session, you will learn more about some of the things CloudFront does behind the scenes to protect the delivery of your content such as OCSP Stapling and Perfect Forward Secrecy. We will also share best practices on how you can use CloudFront to securely deliver content end-to-end, control who accesses your content, how to shield your origins from the Internet, and getting a A+ on SSL labs. View Less
STG203 - Simplified Storage Management and Cloud Backup Using Amazon S3 and Amazon Glacier
This demo-filled session explores how you can use Amazon S3 and Amazon Glacier to store your data in the cloud. By walking through different use cases, we show you how to determine which service is the best fit for your storage requirements. We share lots of Amazon Glacier tips and tricks, and demo features you may not be aware of, such as lifecycle policies, versioning, and website hosting. You see best security practices in action, including correct usage of AWS Identity and Access Management (IAM) users/groups and security policies with your storage implementation. Typical use cases include using AWS storage services for data backup, archiving, data synchronization, and as a file server in the cloud.  Session sponsored by CloudBerry Lab. View Less
STG202 - AWS Import/Export Snowball: Accelerating Large-Scale Data Ingest into AWS Storage Services
Moving terabyte and petabyte volumes of data into the cloud can be a challenge for many businesses. Come learn how you can use Snowball, a new AWS feature, to move large-scale (terabyte and petabyte) data to AWS storage services. View Less
STG201 - State of the Union: AWS Storage Services
General Manager of Amazon Simple Storage Service (Amazon S3), Mai-Lan Tomsen Bukovec, shares what Amazon has learned about running and growing the AWS portfolio of storage services including Amazon S3, Amazon Glacier, Amazon EBS, Amazon Elastic File System (Amazon EFS), and AWS Storage Gateway. Featured in this session is a deep dive into FINRA's journey to the cloud where FINRA manages petabytes of data in the AWS cloud, fulfilling its mission of protecting investors and surveilling financial markets. View Less



Inspired by Rodney Haywood's index in 2012, I decided to do the same for 2013.  I borrowed from his HTML formatting.  The code is this github project which a mix of chrome dev tools web scraping, google data V3 API (YouTube), JSlideShare (with updates required), and JMustache.   Two years ago, I wrote the code in Groovy (~ 150 lines of code) as I wanted quick prototyping and wanted to smaller project to play around with Groovy. Last year I decided to do the code in Scala (~ 150 lines of code as well). The code took two evenings of hacking.  If you see any missing information feel free to issue a pull request to fix it. This year, I did the minimum to make it work for 2015 which required a switch from gdata v2 youtube API's to the newer java client for the V3 google data and youtube API. I haven't posted the code for the update for 2015, but will in a few days.