Difference between ZJU SEL and NTT implementations

Related components

Cloud Properties

• ZJU-SEL

  • cloudstack
    • default_zone
    • default_key_name
    • api_key
    • secret_access_key
    • host
    • port
    • scheme
    • stemcell_server_params (see the crelate_stemcell() section)
  • registry

• NTT

  • cloudstack
    • default_zone
    • default_key_name
    • api_key
    • secret_access_key
    • endpoint (scheme+port+host+path)
  • registry

• Comments

  • 'endpoint' should be easy to describe in the YAML file (yudai)

Stemcell Builder

• ZJU-SEL

  • https://github.com/ZJU-SEL/bosh/tree/zjudev/bosh_agent/misc/stemcell/build2
    • Converting qcow2 (Cloudstack's default template format for KVM)
  • A Stemcell available at: https://github.com/ZJU-SEL/bosh_cloudstack_stemcell

• NTT

  • Added stages to stemcel_builder/stages (copied from OpenStack)
    • Skipping converting qcow2 (using RAW format like AWS)
  • Added a stage collection to bosh-stemcell/lib/bosh/stemcell/stage_collection.rb and some misc modifications
  • Added a temporary task to generate a stemcell locally: local:generate_stemcell
    • See the READEME.md for the details

• Comments

Fog

• ZJU-SEL

  • Implemented CloudStack missing/broken APIs including those introduced by CloudStack 4.2.0
    • PR is now under review
    • https://github.com/ZJU-SEL/fog
    • implement Image.register() to register bosh-stemcell with Cloudstack

• NTT

  • Implemented some missing APIs
    • Hacking Fog internally
      • https://github.com/cloudfoundry-community/bosh-cloudstack-cpi/tree/ntt/bosh_cloudstack_cpi/lib/fog
    • Added: create_template, create/list/delete_tags
    • Other missing well-modeled APIs such as compute.images.create() are still missing

• Comments

  • Importing ZJU-SEL's Fog modification to NTT's hacking directory may be useful (yudai)
    • Once the PR to the original Fog repository merged, we can modify Gemfile (yudai)
  • There is a difference in registering bosh-stemcell to Cloudstack between ZJU-SEL & NTT (DuJun)
    • ZJU-SEL uses intermediate server to store bosh-stemcell and then Cloudstack register it from the site while NTT put forward a solution like AWS EBS (DuJun)

BOSH Registry

• ZJU-SEL

  • Added: https://github.com/ZJU-SEL/bosh/tree/zjudev/bosh_cloudstack_registry
  • BOSH 0.5.0 style?

• NTT

  • Added: https://github.com/cloudfoundry-community/bosh-cloudstack-cpi/blob/ntt/bosh-registry/lib/bosh/registry/instance_manager/cloudstack.rb

• Comments

  • NTT version seems simply newer (yudai)

BOSH Director

• ZJU-SEL

• NTT

  • Added just a gem dependency: https://github.com/cloudfoundry-community/bosh-cloudstack-cpi/blob/ntt/bosh-director/bosh-director.gemspec#L26

• Comments

BOSH dev

• ZJU-SEL

  • Missing?

• NTT

  • Added some misc modification to build stemcells

• Comments

release

• ZJU-SEL

  • Added modification for CloudStack
  • BOSH 0.5.0 style?

• NTT

  • Added modification for CloudStack
  • BOSH 1.5.0 style

• Comments

  • NTT version seems newer (yudai)

BOSH CLI Plugin Micro (bosh_deployer)

• ZJU-SEL

  • Added: https://github.com/ZJU-SEL/bosh/blob/zjudev/bosh_deployer/lib/deployer/instance_manager/cloudstack.rb

• NTT

  • Added: https://github.com/cloudfoundry-community/bosh-cloudstack-cpi/blob/ntt/bosh_cli_plugin_micro/lib/bosh/deployer/instance_manager/cloudstack.rb

• Comments

  • NTT's version seems to be based on a newer version openstack.rb (yudai)
  • ZJU-SEL version supports multiple NICs (yudai)
    • https://github.com/ZJU-SEL/bosh/blob/zjudev/bosh_deployer/lib/deployer/instance_manager/cloudstack.rb#L129-L132 (yudai)
    • using server.ipaddresses (yudai)
    • This looks better than NTT version (yudai)

BOSH release (renamed package_compiler)

• ZJU

  • No modification

• NTT

  • Added some lines for CloudStack
    • https://github.com/cloudfoundry-community/bosh-cloudstack-cpi/blob/ntt/bosh-release/lib/bosh/release/compiler.rb#L151
    • https://github.com/cloudfoundry-community/bosh-cloudstack-cpi/blob/ntt/bosh-release/bin/bosh-release#L6

• Comments

  • NTT version seems suitable (yudai)

bosh_cloudstack_cpi

create_stemcell() in cloud.rb

• ZJU

  • Uploads stemcell file once to a 'stemcell sever' and it exposes a HTTP endpoint
  • Uses registerTemplate() to upload stemcell images
    • http://cloudstack.apache.org/docs/api/apidocs-4.0.0/user/registerTemplate.html
    • OpenStack's approach
    • Requires a stemcell server
  • Stemcell image type is qcow2

• NTT

  • Attaches a volume and copy image to the volume using the dd command
    • The root partition is automatically epanded to the volume size
  • Uses createTemplate() to create stemcell template
    • http://cloudstack.apache.org/docs/api/apidocs-4.0.0/user/createTemplate.html
    • AWS's approach
    • Requires an inception server

• Comments

  • Which is better? (yudai)

create_vm() in cloud.rb

• ZJU

• Looks smarter thanks to modified Fog gem

• Launches VMs with an ephemeral (data) volume

• secury_groups?

• NTT

  • Launches VMs without an ephemeral (data) volume
    • Root volume is enough big like 30GB

• Comments

• We can add an option to use ephemeral data disk (yudai)

current_vm_id() in cloud.rb

• ZJU

  • Metadata server IP is hardcoded: 169.254.169.254

• NTT

  • Extracts from /var/lib/dhcp3/

• Comments

  • The IP addresses of metadata servers should be variable (yudai)

vip_network.rb

• ZJU

  • Supports Floating IPs (Advanced Zones)

• NTT

  • Supports only Basic Zones

• Comments

  • Need to add new types like 'basic_vip' and 'advannced_vip'? (yudai)
    • Or add an option in cloud_properties? (yudai)