Skip to content

Update dataproc.py#46

Open
tacoelho wants to merge 1 commit intoglobocom:masterfrom
tacoelho:patch-1
Open

Update dataproc.py#46
tacoelho wants to merge 1 commit intoglobocom:masterfrom
tacoelho:patch-1

Conversation

@tacoelho
Copy link
Copy Markdown

Replace googleapiclient with dataproc python package #15

Pull Request Template

Description

Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.

Minor change to dataproc.py

Fixes # (issue)

#15

Type of change

Please mark options that are relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • [x ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • [x ] This change requires a documentation update

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

  • Test A
  • Test B

Checklist:


Replace googleapiclient with dataproc python package globocom#15
Copy link
Copy Markdown
Contributor

@regismachado regismachado left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hello @tacoelho

Please review your code, because it´s added some issues and isn´t make proper use of the dataproc api.

Ware expecting for a complete substituion of googleapi discovery client for the google dataproc api.

self.__region = region
self.__logger = logging.getLogger(name=self.__class__.__name__)
self.__logger = logging.getLogger(cluster_name=self.__class__.__name__)
self.__client = discovery.build('dataproc', 'v1', http=http)
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi, please verify your changes.

You removed discovery import but keep using it in this line.

import os
import re
from googleapiclient import discovery
from google.cloud import dataproc
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Imported dataproc but it´s not being used

@tacoelho
Copy link
Copy Markdown
Author

Hey, @regismachado I'll check it out.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants