Hue Load Balancer TLS Errors

This is a reblog from the Clairvoyant blog.

If you are configuring the Hue load balancer with Apache httpd 2.4 and TLS certificates, there is a chance that you may end up with errors. The httpd proxy will check the certificates of the target systems and if they do not pass some basic consistency checks, the proxied connection fails.

Read more of my post on the Clairvoyant blog.

puppet cloudera module 3.0.0

This is a major release of my Puppet module to deploy Cloudera Manager. The major change is that razorsedge/cloudera now supports the latest releases of dependent modules. razorsedge/cloudera was lagging behind due to the need to support Puppet Enterprise 3.0.1 installations and only recently did those installations finally upgrade.

Notable changes are:

https://forge.puppetlabs.com/razorsedge/cloudera
https://github.com/razorsedge/puppet-cloudera

Let me know if you have any feedback!

puppet cloudera module 2.0.2

This is a minor bugfix release of my Puppet module to deploy Cloudera Manager. When I released the module, I had assumed that the testing I did for the C5 beta2 would be 100% valid for C5 GA.  It turns out that Cloudera shipped a newer version of the Oracle 7 JDK and a symlink that the module creates on RedHat and Suse (/usr/java/default) was pointing at the wrong location.  Upgrading to razorsedge/cloudera 2.0.2 will fix the issue.

Lesson learned: Test, test, and test some more.

Thanks to yuzi-co for reporting the problem.

https://forge.puppetlabs.com/razorsedge/cloudera

https://github.com/razorsedge/puppet-cloudera

Let me know if you have any feedback!

puppet cloudera module 2.0.1

This is a major release of my Puppet module to deploy Cloudera Manager. The major change is that razorsedge/cloudera now supports Cloudera’s latest release, Cloudera Enterprise 5, which adds support for Cloudera Manager 5 and Cloudera’s Distribution of Apache Hadoop (CDH) 5. Additionally, this module and it’s deployment via Puppet Enterprise 3.2 has been certified by Cloudera to be tested and validated to work with Cloudera Enterprise 5.

Cloudera Certified This module is certified on Cloudera 5.

Other changes are:

  • All interaction with the cloudera module can now be done through the main ::cloudera class, including installation of the CM server. This means you can simply toggle the options in ::cloudera to have full functionality of the module.
  • Official operating system support for Debian 7.
  • Installation of Oracle JDK 7.
  • Recommended tuning of the vm.swappiness kernel parameter.
  • Installation of native LZO libraries when the parameter install_lzo => true is selected, even when installing via parcels.
  • Conversion of the README.md file to the Puppet Labs recommended README.markdown formatting.  This has dramatically improved the presentation of the things one needs to know about the module in order to quickly become productive.
  • Taking advantage of the new module metadata to add compatability information to the module page on the Puppet Forge.

If you have not seen the previous changes in version 1.0.1, here is a recap:

  • Allow for use of an external Java module. Not everyone will want to stick with the older version Oracle JDK that Cloudera ships in their software repositories. If you have a module that provides the Oracle JDK and sets $JAVA_HOME in the environment, then just set install_java => false in Class['cloudera'] and make sure the JDK is installed before calling Class['cloudera'].
  • Integrated installation of the Oracle Java Cryptography Extension (JCE) unlimited strength jurisdiction policy files. Set the parameter install_jce => true in Class['cloudera'] .

Deprecation Warnings

  • The class parameters and variables yumserver and yumpath have been renamed to reposerver and repopath respectively. This makes the name more generic as it applies to APT and Zypprepo as well as YUM package repositories.
  • The use_gplextras parameter has been renamed to install_lzo.

One note of mention is that this module does not support upgrading from CDH4 to CDH5 packages, including Impala, Search, and GPL Extras.

https://forge.puppetlabs.com/razorsedge/cloudera

https://github.com/razorsedge/puppet-cloudera

Let me know if you have any feedback!

puppet cloudera module 1.0.0

This is a major milestone release of my Puppet module to deploy Cloudera Manager. The biggest change is that razorsedge/cloudera now supports all of the Cloudera official supported operating systems: SLES 11SP1, Debian 6.0.7, Ubuntu 10.04.4 LTS, and Ubuntu 12.04.2 LTS along with RedHat/CentOS/OEL 5 and 6.

Other changes are:

  • Allow for use of an external Java module. Not everyone will want to stick with the older version Oracle JDK that Cloudera ships in their software repositories. If you have a module that provides the Oracle JDK and sets $JAVA_HOME in the environment, then just set install_java => false in Class['cloudera'] and make sure the JDK is installed before calling Class['cloudera'].
  • Improved JDK installation ordering. Now the JDK will always be installed before the CM agent starts.
  • Integrated installation of the Oracle Java Cryptography Extension (JCE) unlimited strength jurisdiction policy files. Set the parameter install_jce => true in Class['cloudera'] .

If you have not seen the previous changes in version 0.9.2, here is a recap:

  • Default parcels. Now the module will only deploy Cloudera Manager unless the parameter use_parcels => false is set.
  • Updated dependencies. We now support puppetlabs/mysql version >=2.0.0. Support for puppetlabs/postgresql will remain at version 2.x until Puppet Enterprise support a newer version.
  • LZO compression. If you are not using parcels, then setting the parameter use_gplextras => true will install the LZO comprression library packages for MapReduce and Impala.
  • Restructuring of the YUM repos and split of Impala from CDH manifests. This makes it easier for the next item:
  • Addition of Cloudera Search packages for non-parcel deployments.
  • Support for installation of hcatalog, sentry, and sqoop2 packages for non-parcel deployments.

Deprecation Warnings

  • The default for use_parcels will switch to true before the 1.0.0 release.
  • The puppetlabs/mysql dependency will update to version 2. Make sure to review its changelog in the case of an upgrade.
  • The class cloudera::repo will be renamed to cloudera::cdh::repo and the Impala repository will be split out into cloudera::impala::repo.

https://forge.puppetlabs.com/razorsedge/cloudera

https://github.com/razorsedge/puppet-cloudera

Let me know if you have any feedback!

puppet cloudera module 0.9.2

Today, I am releasing a large feature update to my Puppet module to deploy Cloudera Manager. This is in preparation for a 1.0.0 release.

The new features include:

  • Default parcels. Now the module will only deploy Cloudera Manager unless the parameter use_parcels => false is set.
  • Updated dependencies. We now support puppetlabs/mysql version >=2.0.0. Support for puppetlabs/postgresql will remain at version 2.x until Puppet Enterprise support a newer version.
  • LZO compression. If you are not using parcels, then setting the parameter use_gplextras => true will install the LZO comprression library packages for MapReduce and Impala.
  • Restructuring of the YUM repos and split of Impala from CDH manifests. This makes it easier for the next item:
  • Addition of Cloudera Search packages for non-parcel deployments.
  • Support for installation of hcatalog, sentry, and sqoop2 packages for non-parcel deployments.

Deprecation Warnings

  • The default for use_parcels will switch to true before the 1.0.0 release.
  • The puppetlabs/mysql dependency will update to version 2. Make sure to review its changelog in the case of an upgrade.
  • The class cloudera::repo will be renamed to cloudera::cdh::repo and the Impala repository will be split out into cloudera::impala::repo.

https://forge.puppetlabs.com/razorsedge/cloudera

https://github.com/razorsedge/puppet-cloudera

Let me know if you have any feedback!

Doing DevOps with Cloudera Manager

It looks like my work with Puppet has been picked up by the Cloudera Blog. James Ruddy blogged about utilizing my razorsedge/cloudera module in his article Deploy Cloudera Manager with Puppet. Cloudera provided a link to his article under the umbrella of automating the deployment of Cloudera Manager itself.

I think it is awesome that other folks are utilizing code I have worked on. I mainly write this stuff to scratch an itch, and I am happy when other people get some use out of it.