Skip to content

CSI translation for in-tree volumes#5

Open
ddebroy wants to merge 1 commit into
davidz627:feature/VolumeAttchmentAPIfrom
ddebroy:feature/VolumeAttchmentAPI
Open

CSI translation for in-tree volumes#5
ddebroy wants to merge 1 commit into
davidz627:feature/VolumeAttchmentAPIfrom
ddebroy:feature/VolumeAttchmentAPI

Conversation

@ddebroy
Copy link
Copy Markdown

@ddebroy ddebroy commented Apr 16, 2019

A very preliminary version of the CSI translation work for in-tree volumes. This is to make sure my thinking is in the right track.

For GCE PD CSI translation, the ID generation will require access to the labels for the volumes which are not available through labels (as in-tree volumes do not have labels). So we may need to query the cloud to get the labels which may increase time required to provision due to additional cloud API calls.

For the other CSI drivers, it seems the ID generation (based on specific labels) is not necessary and the name appears to be enough.

/cc @davidz627 @msau42 @leakingtapan

Signed-off-by: Deep Debroy <ddebroy@docker.com>
Copy link
Copy Markdown
Owner

@davidz627 davidz627 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

generally looks pretty good to me! did you test it out with a real driver yet?

} else {
return &volume.Spec{}, fmt.Errorf("not a valid volume spec")
// TranslateInTreeVolumeToCSI will create a new PV
csiPV, err = csilib.TranslateInTreeVolumeToCSI(spec.Volume)
Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

many instances of InTreeVolume should be changed to InlineVolume I think

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So I was trying to distinguish TranslateInTreeVolumeToCSI from TranslateInTreePVToCSI as the former handles spec.Volume (associated with inline) while the latter handles Spec.PersistentVolume (associated with PV). I understand the fact that it may not be clear that TranslateInTreeVolumeToCSI is meant to handle inline.

Maybe we can be a bit verbose and call the in-tree in-line translator: TranslateInTreeInlineVolumeToCSI?

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oh I see now, yea lets err on the side of verbosity. It's really long but also this feature is inherently confusing so I think its better we fully qualify names so its marginally easier to understand

pvName := spec.PersistentVolume.GetName()
attachID := getAttachmentName(csiSource.VolumeHandle, csiSource.Driver, node)
var vaSource storage.VolumeAttachmentSource
if spec.InlineVolume == false {
Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: !spec.InlineVolume

}

func translateSpec(spec *volume.Spec) (*volume.Spec, error) {
if spec.PersistentVolume == nil && spec.Volume == nil {
Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: I would prefer this error case as the else block in the below if/else statements as it is kind of the 3rd condition there

PersistentVolumeSource: v1.PersistentVolumeSource{
CSI: &v1.CSIPersistentVolumeSource{
Driver: GCEPDDriverName,
// TODO: PDName is not going to work for GCE. We need to get this to a volIDZonalFmt
Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah i understand the issue now, the format can be:
volID = fmt.Sprintf(volIDZonalFmt, UnspecifiedValue, UnspecifiedValue, pv.Spec.GCEPersistentDisk.PDName)

And what we can do is actually find the disk on the PD driver side when we encounter UnspecifiedValue.

we already do this here: https://github.com/davidz627/kubernetes/pull/5/files#diff-307e088a66bf6532855c7b623e41af8fR121

Copy link
Copy Markdown
Author

@ddebroy ddebroy Apr 17, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Excellent! So the first two conditions where the labels are used to form the volID mainly an optimization to save the cloud lookup?

Copy link
Copy Markdown
Owner

@davidz627 davidz627 Apr 17, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yep! And I just checked the PD CSI Driver code and looks like I predicted this and already implemented it already. kubernetes-sigs/gcp-compute-persistent-disk-csi-driver#129
specifically: https://github.com/kubernetes-sigs/gcp-compute-persistent-disk-csi-driver/pull/129/files#diff-2cae80be86c0ea6e6c4f4b6dfc89c607R67

:D

@ddebroy ddebroy changed the title WIP CSI translation for in-tree volumes CSI translation for in-tree volumes May 28, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants