puppet cloudera module 1.0.0

This is a major milestone release of my Puppet module to deploy Cloudera Manager. The biggest change is that razorsedge/cloudera now supports all of the Cloudera official supported operating systems: SLES 11SP1, Debian 6.0.7, Ubuntu 10.04.4 LTS, and Ubuntu 12.04.2 LTS along with RedHat/CentOS/OEL 5 and 6.

Other changes are:

  • Allow for use of an external Java module. Not everyone will want to stick with the older version Oracle JDK that Cloudera ships in their software repositories. If you have a module that provides the Oracle JDK and sets $JAVA_HOME in the environment, then just set install_java => false in Class['cloudera'] and make sure the JDK is installed before calling Class['cloudera'].
  • Improved JDK installation ordering. Now the JDK will always be installed before the CM agent starts.
  • Integrated installation of the Oracle Java Cryptography Extension (JCE) unlimited strength jurisdiction policy files. Set the parameter install_jce => true in Class['cloudera'] .

If you have not seen the previous changes in version 0.9.2, here is a recap:

  • Default parcels. Now the module will only deploy Cloudera Manager unless the parameter use_parcels => false is set.
  • Updated dependencies. We now support puppetlabs/mysql version >=2.0.0. Support for puppetlabs/postgresql will remain at version 2.x until Puppet Enterprise support a newer version.
  • LZO compression. If you are not using parcels, then setting the parameter use_gplextras => true will install the LZO comprression library packages for MapReduce and Impala.
  • Restructuring of the YUM repos and split of Impala from CDH manifests. This makes it easier for the next item:
  • Addition of Cloudera Search packages for non-parcel deployments.
  • Support for installation of hcatalog, sentry, and sqoop2 packages for non-parcel deployments.

Deprecation Warnings

  • The default for use_parcels will switch to true before the 1.0.0 release.
  • The puppetlabs/mysql dependency will update to version 2. Make sure to review its changelog in the case of an upgrade.
  • The class cloudera::repo will be renamed to cloudera::cdh::repo and the Impala repository will be split out into cloudera::impala::repo.



Let me know if you have any feedback!

About Michael Arnold
This is where I write about all of my unix hacking experiences so that you may be able to learn from my troubles.

2 Responses to puppet cloudera module 1.0.0

  1. jkestelyn says:

    This is awesome. Can I interest you in writing a guest blog post for blog.cloudera.com?

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: