Skip to content

Adds Knox Support#12

Open
att-bdpaas wants to merge 3 commits into
kzk:masterfrom
att-bdpaas:master
Open

Adds Knox Support#12
att-bdpaas wants to merge 3 commits into
kzk:masterfrom
att-bdpaas:master

Conversation

@att-bdpaas

Copy link
Copy Markdown

We are using WebHDFS through a Knox gateway.

This requires:

  1. Specifying the gateway and the cluster to the path
  2. Support for basic auth

Let us know if you have any questions/ feedback about this PR.

Thanks!

@tagomoris

Copy link
Copy Markdown
Collaborator

I'm sorry for late reply.
Are there any other Knox gateway users? I cannot find anyone around me.
I'll re-consider to merge if any others adds comments for merge.

About patch, I think that we should change API of initialize like below, and change username/doas/proxy_address/proxy_port as deprecated:

def initialize(host='localhost', port=50070, username=nil, doas=nil, proxy_address=nil, proxy_port=nil, options={})
   # check options[:username], options[:doas], ... , options[:knox_path], ...
   # ...
end

@tlabeeuw

tlabeeuw commented Dec 1, 2014

Copy link
Copy Markdown

Knox is obviously relatively new, but is definitely shaping up to be the standard way to connect to a secure Kerberized cluster. Both Hortonworks and Cloudera now have it available.

Regarding the initialize method this seems like a decent approach. Though it does seem arbitrary what goes in options and what goes as positioned arguments. Ruby's 2.0 named arguments would solve this but guessing you want your library to support as many Ruby versions as possible.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants