VMware 面向开发者的云计算技术

VMware 面向开发者的云计算技术Lightwave, Photon, AppCatalyst, and BonnevilleEmma Lin/蔺永华, Staff II Engineer, Vmware China R&DJuly 14-15© 2014 VMware Inc. All rights reserved.About MeCONFIDENTIAL ▪Tech lead of VMware Cloud Native Infrastructure team▪Lead multiple VMware products development, including Big Data,OpenStack and containers support.▪More than 10 years development experience on distributedsystem.2Agenda1Industry Trends2 Cloud Native Applications Definition3 VMware Cloud-Native Applications Initiative3.1 Photon3.2 AppCatalyst3.3 Bonneville3.4 LightwaveMobile-Cloud Era = Increased Customer ExpectationsEverything On-Demand Fully Functional,All the TimeAccessibleEverywhereApplications must be more resilient than ever!Market Expectations drive Operational Changes for CustomersIT decisions moving to LOB and applicationdevelopers Applications brokeninto microservices Continuous Delivery Several times a dayDo everything fasterAgenda1Industry Trends2 Cloud Native Applications Definition3 VMware Cloud-Native Applications Initiative3.1 Photon3.2 AppCatalyst3.3 Bonneville3.4 LightwaveA New Application Architecture is emergingProperties of a microservice✓Small code base✓Easy to scale, deploy and throw away✓Autonomous✓ResilientBenefits of a microservices architecture✓A highly resilient, scalable and resourceefficient application✓Enables smaller development teams✓Teams free to use the right languages andtools for the job✓Rapid application development7Changing I nfrastructure Needs From…Server Workload1Workload2Workload3Server Server ServerWorkload ConsolidationApplication DistributiontoApplicationThe Cloud Native ApplicationServer Server ServerCloud Native ApplicationsLeverage elastic infrastructure to•Provision instances of itself •Scale up and down•Detect and work around failuresCloud Native Application ArchitectureServer Server Server Distributed and Scale-out •Microservices•Linux Containers•Open-source componentsApplicationHardwareOS Kernel OS File system U s e r s p a c eContainerA p p p r o c e s sA p p p r o c e s sA p p p r o c e s sA p p p r o c e s sA p p p r o c e s sContainerA p p p r o c e s sA p p p r o c e s sMicroservices with ContainersOS-level Isolation•Isolation at individual kernel subsystem level (e.g. filesystem, process table, etc)•User-level process orchestrates thesesubsystems to create a containerExisted for Many Years•Solaris Zones, FreeBSD Jails, OpenVZ, LXC Why?•Process isolation with good performance isolation•Reproducible environment•Enables management at scaleIt’s a Challenging Jump to Cloud Native ApplicationContainersDO NOT provide:Fragmented EcosystemsHidden Costs•Management tools•Container sprawl•Governance challengesSecurity isolationDataPersistenceGuaranteedResourcesOvercommit andrebalancingAgenda1Industry Trends2 Cloud Native Applications Definition3 VMware Cloud-Native Applications Initiative3.1 Photon3.2 AppCatalyst3.3 Bonneville3.4 LightwaveOur MissionMake the Developer aFirst-Class User of the Data Center•Build technologies that span the app lifecycle•Empower operations teams to manage Cloud-Nativeapplications•Build to and support open systems and standardsAgenda1Industry Trends2 Cloud Native Applications Definition3 VMware Cloud-Native Applications Initiative3.1 Photon3.2 AppCatalyst3.3 Bonneville3.4 LightwaveThree Focus AreasDeveloper DesktopProductionStack DevOps LifecycleContainer ReppositoriesDev’s LaptopOptional: Type 2 HypervisorLinuxDeveloper Tools Container Packaginge.g. Hashicorp Vagrante.g. Docker/Docker Hube.g. RedHat, Ubuntu, Boot2Docker, CoreOSe.g. Fusion, Workstation, Player, VirtualBoxDeveloperApp Definition, Policies, and ProvisioningContainer ReppositoriesDev’s LaptopOptional: Type 2 HypervisorLinuxDeveloper Tools Container Packaginge.g. Hashicorp Vagrante.g. Docker/Docker Hube.g. RedHat, Ubuntu, Boot2Docker, CoreOSe.g. Fusion, Workstation, Player, VirtualBoxDeveloperApp Definition, Policies, and ProvisioningSecure Container RuntimeContainer Optimized Linux OSDocker, rkt and Garden (Pivotal) supportMinimal footprint to run containersvSphere IntegrationPart of your vSphere installHypervisor-optimized container runtimeUpdates from VMwareEnterprise supportSecurity and update patches from VMwareOpen SourceGPL v2 License•Minimal footprint•Application runtime•Installation time: ~9 sec.•Full package catalog installed •Complete installation for developer desktop or test environment •Installation time: ~37 sec. •Minimal footprint •Container host •Installation time: ~12 sec. •Minimal footprint •Flexible installation allows package selection •Installation time: VariableInstallation ProfilesPhotonISOPhoton Directions•VMware-optimized container host–Guest customization support – improved vSphere and vCloud Air compatibility–Shared folders for Workstation & Fusion – streamline developer to production pipeline–Lightwave integration – single identity across all infrastructure–Software Defined Datacenter for Containers – single operational model for all workloads–Performance and packaging optimizations – faster boot, smaller footprint•Secure container stack–Signed packages – ensures trust of VMware packages–Lightwave integration – extends trust to containers and container authors–Secure boot and attestation – creates a chain of trust from the hardware, through the hypervisor, to the containerAgenda1Industry Trends2 Cloud Native Applications Definition3 VMware Cloud-Native Applications Initiative3.1 Photon3.2 AppCatalyst3.3 Bonneville3.4 LightwaveDev’s LaptopVMware AppCatalystLinuxContainer PackagingDeveloperContainer Developer StackDeveloper Tools Replacement of VirtualBoxIntegrated with Docker Machine and VagrantApp Definition, Policies, and ProvisioningVMware AppCatalystDatacenter-in-a-laptop, model production deployments on your laptop •Same battle-tested virtualization engine as Fusion and Workstation •Drop-in replacement for Virtualbox in Docker Machine and VagrantDeveloper-Friendly•Optimized to support developer workflows•Exposes REST API with command-line interface•No UI to mess with, built to run fast and meanDownload Technology Preview todayDeveloper DesktopVMware AppCatalystC L IR E S T A P INetwork and Storage Abstractions (coming soon)Docker MachineContainer ContainerContainerContainer ContainerContainerVMware AppCatalystVagrantOrBring your own LinuxAgenda1Industry Trends2 Cloud Native Applications Definition3 VMware Cloud-Native Applications Initiative3.1 Photon3.2 AppCatalyst3.3 Bonneville3.4 LightwaveThree Focus AreasDeveloper DesktopProductionStack DevOps LifecycleDev is fast, but Apps still get delivered lateProductionAgile Software Development with Continuous IntegrationDevelopmentRelease process with agile developmentTestStageUAT Load TestDevOps ConflictFrequent release of small setsof changesManual steps in the releaseprocessDev wants to push quickly intoproductionOperations wants stability / nochangeDevelopment LifecycleProvisioning &Deployment Artifact Repository Docker HubJFrogArtifactoryChefAnsibleSalt StackCode Repo GitPerforceCI/CDCloudBees JenkinsAtlassian BambooDeveloper DesktopProduction StackApp Definition, Policies, and ProvisioningProduction Stacke.g. Kubernetes, docker swarm, Mesos, Fleete.g. CoreOS, Atomic, UbuntuManagementvCloud Automation Center, vCenter Operations, Log InsightPhotonContainer Packaging Container Cluster SchedulerInfrastructureESXi, NSX, Virtual SANvCloud Hybrid Servicee.g. DockerProduction App Definition, Policies, and ProvisioningProject BonnevilleManagementvCloud Automation Center, vCenter Operations, Log Insight PhotonContainer PackagingContainer Cluster SchedulerInfrastructureESXi, NSX, Virtual SAN vCloud Hybrid ServiceProductionBonnevilleManagementvCloud Automation Center, vCenter Operations, Log Insight VM Container/Photon Container Cluster SchedulerInfrastructureESXi, NSX, Virtual SAN vCloud Hybrid ServiceProductionApp Definition, Policies, and ProvisioningContainer IsolationVM ContainerProject BonnevilleThe convenience of Docker containers with the management andsecurity of vSphereDocker containers encapsulated as virtual machines•Everything in ESX becomes a well-isolated VM “container”•Customers can move containers in and out of vSphere seamlesslyComplete API compatibility with Docker•Containers visible to IT administrators when running on ESX•Works with full ecosystem of Docker clientsGreater security and resource efficiency•No container host operating system to maintain.•ESX clustering allows for more efficient multi-tenant accessBonneville ArchitectureDocker HubVanillaDocker ClientBonneville Docker DaemonESXi HOSTDocker ImagesContainerContainerLegacy VMDocker REST API ControlPull ImageMount Image•Containers are first-class citizens on the hypervisor•No need for a separately managed Linux container host, ESX is the container host•Virtualization brings many benefits: Security, Isolation and multiple-OS supportContainerBonneville PerformanceAgenda1Industry Trends2 Cloud Native Applications Definition3 VMware Cloud-Native Applications Initiative3.1 Photon3.2 AppCatalyst3.3 Bonneville3.4 LightwaveHow Will We Secure Cloud-Native Applications?Challenges•Complex networks of microservices•Services themselves are complex distributed systems•Many points of attackNeeds•Scalable identity infrastructure •Network isolation •Trusted compute runtimeApplicationApplicationApplicationIdentity and Access ManagementLightwave Cloud-Native Security SolutionContainer EngineContainer Container ContainerRepositoryLinux Network Open Virtual Networking (OVN)PhotonOrchestration & SchedulingCloud-Native Identity & Access ManagementIdentity, Authentication andAuthorization ServerLDAP, Kerberos, SAML, OAuth2.0, x.509Scalable ArchitectureMulti-master state-based replicationMulti-data center replicationMulti-TenantMultiple independent forestsOpen SourceApache 2.0Cloud-Native Identity & Access ManagementPrimary Components:•VMware Directory Service (vmdir)•VMware Certificate Authority (vmca)•VMware Authentication FrameworkDaemon/Service (vmafd)•VMware Secure Token Service (vmware-sts)This is Just the Beginning…@cloudnativeapps#vmwcnavmware.github.ioKey TakeawayDev’s Laptop VMware AppCatalystLinuxContainer PackagingDeveloperDeveloper Tools Provisioning &Deployment Artifact Repository Docker HubJFrogArtifactoryChefAnsibleSalt StackCode Repo GitPerforceCI/CD CloudBees JenkinsAtlassian BambooManagementvCloud Automation Center, vCenter Operations, LogInsightVM Container/Photon Container ClusterScheduler InfrastructureESXi, NSX, Virtual SAN vCloud Hybrid ServiceProductionDevOps LifecycleApp Definition, Policies, and ProvisioningIdentity and Access ManagementLightwave Key takeawayContainer EngineContainer Container ContainerRepositoryLinux Network Open Virtual Networking (OVN)PhotonOrchestration & SchedulingVMware助力应用OpenStack •2015/07/??vSphere Basic ElementsSDDC: A Unified Platform for Traditional & Modern ApplicationsResilience Security QoSTraditional AppsOS AppVirt HWSoftware-Defined Data Center ESXi, NSX, Virtual SANOS AppVirt HWOS AppVirt HWOS AppVirt HWOS AppVirt HWAgility PortabilityModern Apps Container OS Hadoo p Kubernetes / DockerOSAppVirt HWOS AppVirt HWCloud FoundryOpenStackOS AppVirt HWVirt HWAppApp AppAppOS AppVirt HWSpringAny HardwareOpen Cloud APIs•Contribute to open source projects. •Differentiate with SDDC value. •Enable customers to easily adopt.OpenStack Conceptual Architecture20142013 201020112012 Contribute: Strong, Comprehensive OpenStack EngagementOpenStackProject Created by Rackspace &NASA Open vSwitch Project Created by Nicira OpenStack Networking “Neutron” project started, led by Nicira.VMware acquires Nicira,Joins OpenStack Foundation as Gold member.VMware Integrated OpenStack (VIO) Beta Announced.NSX+NeutronvSphere+NovavSphere+CindervSphere+GlancevSphere+CeilometerKey OpenStack Distros Announce Support for vSphere & NSX in theirOpenStack distros.414 Commits21 Developers 66,488 Lines-of-Code VMware Icehouse:#4 contributor to core projects.3770 Patches ReviewedEcosystemUpstreamContributions“Congress” PolicyOpenStack Framework Delivers Cloud-Style APIs & Services for DevelopersApplication DevOps teamprovisioncode updatescale up/downScripts / codeAPI callsOpenStack IaaS Cloudapp mgmt toolorWorkloads Targeted for OpenStack•Primarily new workloads , or “repatriated” applications from a public cloud. Very few Tier-1 workloads •Common examples:•Scale-out SaaS/Web applications, mobile back-ends •Dev/Build/Test, Continuous Integration•Research / batch-processing: data analytics, encoding, simulation, etc.Is OpenStack Interesting for your Private Cloud?Virtual Infrastructure。