ืืื ืคืึธืจืฉืืขืื ืฆื ืืืื ืืคืืขืจืงืืึทืืงืืึทื ืึท ืืืืึธืจืืึทื ืคึฟืึทืจ ืืืฉืขื ืขืจืืืืื ื ืึทืงืกืขืก ืฆื ืึท Kubernetes ืงื ืืื ื ืืฆื Dex, dex-k8s-authenticator ืืื GitHub.
ืืืงืืืข ืืขืืข ืคืื โโืื ืจืืกืืฉ-ืฉืคึผืจืึทื Kubernetes ืฉืืืขืกื ืืื
ืืงืืื
ืืืจ ื ืืฆื Kubernetes ืฆื ืฉืึทืคึฟื ืืื ืึทืืืฉ ืื ืืืืืจืึทื ืืึทื ืฅ ืคึฟืึทืจ ืื ืึทื ืืืืืงืืื ื ืืื ืงืึท ืืึทื ืฉืึทืคึฟื. ืึทืืื ืืืจ ืืืืื ืฆื ืืขืื ืืื ืึทืงืกืขืก ืฆื ืื ืงื ืืื ืคึฟืึทืจ ืืืืืข ืื ืืึทืฉืืึธืจื ืืื ืงืืืขืงืื. ื ืื ืขื ืืขื OpenShift, ืืืึทื ืื ืงืืืขืจื ืขืืขืก ืืื ื ืืฉื ืืขืืืืจื ืึธืืขื ืืึทืงืืืฉืึทื, ืึทืืื ืืืจ ื ืืฆื ืืจืื-ืคึผืึทืจืืื ืืืฉืืจืื ืคึฟืึทืจ ืืขื.
ืืื ืืขื ืงืึทื ืคืืืืขืจืืืฉืึทื ืืืจ ื ืืฆื:
dex-k8s-authenticatorโ - ืืืขื ืึทืคึผืืึทืงืืืฉืึทื ืคึฟืึทืจ ืืืฉืขื ืขืจืืืืื ื kubectl configืืขืงืก - OpenID Connect ืฉืคึผืืึทืืขืจ- GitHub - ืคืฉืื ืืืืึทื ืืืจ ื ืืฆื GitHub ืืื ืืื ืืืขืจ ืคืืจืืข
ืืืจ ืืขืคืจืืืื ืฆื ื ืืฆื Google OIDC, ืึธืืขืจ ืืืืืขืจ ืืืจ
ืืื ืึทืืื ืึทืจืืขื ืืื ืืืขืจ Kubernetes ืืขืจืืืืืขื ืืฉ ืคึผืจืึธืฆืขืก ืืื ืึท ืืืืืฉืึทืืืึทื ืคืึทืจืืจืขืืื ื:
ืืขืจืืืืืขื ืืฉ ืคึผืจืึธืฆืขืก
ื ืืืกื ืืขืจ ืืขืืึทื ืืื ืคืื ื ืืืจื ืคืื ื:
- ืืึทื ืืฆืขืจ ืืึธืืก ืืื dex-k8s-authenticator (
login.k8s.example.com
) - dex-k8s-authenticator ืคืึธืจืืืขืจืืื ืื ืืงืฉื ืฆื Dex (
dex.k8s.example.com
) - ืืขืงืก ืจืืืขืจืขืงืฅ ืฆื ืื GitHub ืืึธืืื ืืืึทื
- GitHub ืืืฉืขื ืขืจืืืฅ ืื ื ืืืืืง ืืขืจืืืืืขื ืืฉ ืืื ืคึฟืึธืจืืึทืฆืืข ืืื ืงืขืจื ืขืก ืฆื Dex
- Dex ืคึผืึทืกืื ืื ืืืงืืืขื ืืื ืคึฟืึธืจืืึทืฆืืข ืฆื dex-k8s-authenticator
- ืืขืจ ืืึทื ืืฆืขืจ ืืืงืืื ืึทื OIDC ืืึธืงืขื ืคึฟืื GitHub
- dex-k8s-authenticator ืืืกืืฃ ืกืืืขื ืฆื kubeconfig
- kubectl ืคึผืึทืกืื ืื ืกืืืขื ืฆื KubeAPIServer
- KubeAPIServer ืงืขืจื ืึทืงืกืขืก ืฆื kubectl ืืืืืจื ืืืืฃ ืื ืืืจืืืขืืื ืืขื ืกืืืขื
- ืืขืจ ืืึทื ืืฆืขืจ ืืึทืงืืืขื ืึทืงืกืขืก ืคึฟืื kubectl
ืคึผืจืขืคึผืึทืจืึทืืึธืจื ืึทืงืืืืืืืขืื
ืืึธื, ืืืจ ืืึธืื ืฉืืื ืืื ืกืืึทืืืจื ืึท ืงืืืขืจื ืขืืขืก ืงื ืืื (k8s.example.com
), ืืื ืืืื ืงืืื ืืื HELM ืคืึทืจ-ืืื ืกืืึทืืืจื. ืืืจ ืืืื ืืึธืื ืึทื ืึธืจืืึทื ืืืึทืฆืืข ืืืืฃ GitHub (ืกืืคึผืขืจ-ืึธืจื).
ืืืื ืืืจ ืืึธื ื ืื ืืึธืื HELM, ืื ืกืืึทืืืจื ืขืก
ืขืจืฉืืขืจ ืืืจ ืืึทืจืคึฟื ืฆื ืื ืกืืึทืืืจื GitHub.
ืืืื ืฆื ืื ืึธืจืืึทื ืืืึทืฆืืข ืกืขืืืื ืืก ืืืึทื, (https://github.com/organizations/super-org/settings/applications
) ืืื ืฉืึทืคึฟื ืึท ื ืืึทืข ืึทืคึผืืึทืงืืืฉืึทื (ืึทืืืืึธืจืืืขื OAuth ืึทืคึผ):
ืฉืึทืคึฟื ืึท ื ืืึทืข ืึทืคึผืืึทืงืืืฉืึทื ืืืืฃ GitHub
ืคึผืืึธืืืืจื ืื ืคืขืืืขืจ ืืื ืื ื ืืืืืง URL ืก, ืคึฟืึทืจ ืืืึทืฉืคึผืื:
- ืืึธืืขืคึผืึทืืข URL:
https://dex.k8s.example.com
- ืืขืจืืืืืขื ืืฉ ืงืึทืืback URL:
https://dex.k8s.example.com/callback
ืืืื ืึธืคึผืืขืืื ืืื ืืื ืงืก, ืขืก ืืื ืืืืืืืง ื ืืฉื ืฆื ืคืึทืจืืืจื ืกืืึทืฉืื.
ืืื ืขื ืืคืขืจ ืฆื ืึท ืืขืขื ืืืงื ืคืึธืจืขื, GitHub ืืืขื ืืืฉืขื ืขืจืืื Client ID
ะธ Client secret
, ืืึทืืื ืืื ืืื ืึท ืืืืขืจ ืคึผืืึทืฅ, ืืื ืืืขืื ืืืื ื ืืฆืืง ืคึฟืึทืจ ืืื ืื (ืืืฉื, ืืืจ ื ืืฆื
Client ID: 1ab2c3d4e5f6g7h8
Client secret: 98z76y54x32w1
ืฆืืืจืืืื ืื ืก ืจืขืงืึธืจืืก ืคึฟืึทืจ ืกืืืืึธืืึทืื ืก login.k8s.example.com
ะธ dex.k8s.example.com
, ืืื ืืขืืื ื ืืื ืกืกื ืกืขืจืืืคืืงืึทืฅ ืคึฟืึทืจ ืื ืืจืขืกืก.
ืืึธืืืจ ืืึทืื SSL ืกืขืจืืืคืืงืึทืฅ:
cat <<EOF | kubectl create -f -
apiVersion: certmanager.k8s.io/v1alpha1
kind: Certificate
metadata:
name: cert-auth-dex
namespace: kube-system
spec:
secretName: cert-auth-dex
dnsNames:
- dex.k8s.example.com
acme:
config:
- http01:
ingressClass: nginx
domains:
- dex.k8s.example.com
issuerRef:
name: le-clusterissuer
kind: ClusterIssuer
---
apiVersion: certmanager.k8s.io/v1alpha1
kind: Certificate
metadata:
name: cert-auth-login
namespace: kube-system
spec:
secretName: cert-auth-login
dnsNames:
- login.k8s.example.com
acme:
config:
- http01:
ingressClass: nginx
domains:
- login.k8s.example.com
issuerRef:
name: le-clusterissuer
kind: ClusterIssuer
EOF
kubectl describe certificates cert-auth-dex -n kube-system
kubectl describe certificates cert-auth-login -n kube-system
ClusterIssuer ืืื ืืืื le-clusterissuer
ืืึธื ืฉืืื ืขืงืกืืกืืืจื, ืึธืืขืจ ืืืื ื ืืฉื, ืฉืึทืคึฟื ืขืก ืืื HELM:
helm install --namespace kube-system -n cert-manager stable/cert-manager
cat << EOF | kubectl create -f -
apiVersion: certmanager.k8s.io/v1alpha1
kind: ClusterIssuer
metadata:
name: le-clusterissuer
namespace: kube-system
spec:
acme:
server: https://acme-v02.api.letsencrypt.org/directory
email: [email protected]
privateKeySecretRef:
name: le-clusterissuer
http01: {}
EOF
ืงืืืขืึทืคึผืืกืขืจืืืขืจ ืงืึทื ืคืืืืขืจืืืฉืึทื
ืคึฟืึทืจ kubeAPIServer ืฆื ืึทืจืืขืื, ืืืจ ืืึทืจืคึฟื ืฆื ืงืึทื ืคืืืืขืจ OIDC ืืื ืืขืจืืืึทื ืืืงื ืืขื ืงื ืืื:
kops edit cluster
...
kubeAPIServer:
anonymousAuth: false
authorizationMode: RBAC
oidcClientID: dex-k8s-authenticator
oidcGroupsClaim: groups
oidcIssuerURL: https://dex.k8s.example.com/
oidcUsernameClaim: email
kops update cluster --yes
kops rolling-update cluster --yes
ืืืจ ื ืืฆื
ืืขืงืก ืงืึทื ืคืืืืขืจืืืฉืึทื ืืื dex-k8s-authenticator
ืคึฟืึทืจ Dex ืฆื ืึทืจืืขืื, ืืืจ ืืึทืจืคึฟื ืฆื ืืึธืื ืึท ืืึทืืืืึทืื ืืื ืึท ืฉืืืกื ืคืื ืื Kubernetes ืืขื, ืืึธืื ืืื ืื ืืึทืงืืืขื ืขืก ืคึฟืื ืืึธืจื:
sudo cat /srv/kubernetes/ca.{crt,key}
-----BEGIN CERTIFICATE-----
AAAAAAAAAAABBBBBBBBBBCCCCCC
-----END CERTIFICATE-----
-----BEGIN RSA PRIVATE KEY-----
DDDDDDDDDDDEEEEEEEEEEFFFFFF
-----END RSA PRIVATE KEY-----
ืืึธืืืจ ืงืืึธืื ืื dex-k8s-authenticator ืจืืคึผืึทืืึทืืึธืจื:
git clone [email protected]:mintel/dex-k8s-authenticator.git
cd dex-k8s-authenticator/
ื ืืฆื ืืืึทืืืขืก ืืขืงืขืก, ืืืจ ืงืขื ืขื ืคืืขืงืกืึทืืึทื ืงืึทื ืคืืืืขืจ ืืืขืจืืึทืืึทืื ืคึฟืึทืจ ืืื ืืืขืจ
ืืึธืืืจ ืืึทืฉืจืืึทืื ืื ืงืึทื ืคืืืืขืจืืืฉืึทื ืคึฟืึทืจ Dex:
cat << EOF > values-dex.yml
global:
deployEnv: prod
tls:
certificate: |-
-----BEGIN CERTIFICATE-----
AAAAAAAAAAABBBBBBBBBBCCCCCC
-----END CERTIFICATE-----
key: |-
-----BEGIN RSA PRIVATE KEY-----
DDDDDDDDDDDEEEEEEEEEEFFFFFF
-----END RSA PRIVATE KEY-----
ingress:
enabled: true
annotations:
kubernetes.io/ingress.class: nginx
kubernetes.io/tls-acme: "true"
path: /
hosts:
- dex.k8s.example.com
tls:
- secretName: cert-auth-dex
hosts:
- dex.k8s.example.com
serviceAccount:
create: true
name: dex-auth-sa
config: |
issuer: https://dex.k8s.example.com/
storage: # https://github.com/dexidp/dex/issues/798
type: sqlite3
config:
file: /var/dex.db
web:
http: 0.0.0.0:5556
frontend:
theme: "coreos"
issuer: "Example Co"
issuerUrl: "https://example.com"
logoUrl: https://example.com/images/logo-250x25.png
expiry:
signingKeys: "6h"
idTokens: "24h"
logger:
level: debug
format: json
oauth2:
responseTypes: ["code", "token", "id_token"]
skipApprovalScreen: true
connectors:
- type: github
id: github
name: GitHub
config:
clientID: $GITHUB_CLIENT_ID
clientSecret: $GITHUB_CLIENT_SECRET
redirectURI: https://dex.k8s.example.com/callback
orgs:
- name: super-org
teams:
- team-red
staticClients:
- id: dex-k8s-authenticator
name: dex-k8s-authenticator
secret: generatedLongRandomPhrase
redirectURIs:
- https://login.k8s.example.com/callback/
envSecrets:
GITHUB_CLIENT_ID: "1ab2c3d4e5f6g7h8"
GITHUB_CLIENT_SECRET: "98z76y54x32w1"
EOF
ืืื ืคึฟืึทืจ dex-k8s-authenticator:
cat << EOF > values-auth.yml
global:
deployEnv: prod
dexK8sAuthenticator:
clusters:
- name: k8s.example.com
short_description: "k8s cluster"
description: "Kubernetes cluster"
issuer: https://dex.k8s.example.com/
k8s_master_uri: https://api.k8s.example.com
client_id: dex-k8s-authenticator
client_secret: generatedLongRandomPhrase
redirect_uri: https://login.k8s.example.com/callback/
k8s_ca_pem: |
-----BEGIN CERTIFICATE-----
AAAAAAAAAAABBBBBBBBBBCCCCCC
-----END CERTIFICATE-----
ingress:
enabled: true
annotations:
kubernetes.io/ingress.class: nginx
kubernetes.io/tls-acme: "true"
path: /
hosts:
- login.k8s.example.com
tls:
- secretName: cert-auth-login
hosts:
- login.k8s.example.com
EOF
ืื ืกืืึทืืืจื Dex ืืื dex-k8s-authenticator:
helm install -n dex --namespace kube-system --values values-dex.yml charts/dex
helm install -n dex-auth --namespace kube-system --values values-auth.yml charts/dex-k8s-authenticator
ืืึธืืืจ ืงืึธื ืืจืึธืืืจื ืื ืคืึทื ืืงืฉืึทื ืึทืืืื ืคืื ืื ืกืขืจืืืืกืขืก (ืืขืงืก ืืึธื ืฆืืจืืงืงืืืขื ืงืึธื 400, ืืื dex-k8s-authenticator ืืึธื ืฆืืจืืงืงืืืขื ืงืึธื 200):
curl -sI https://dex.k8s.example.com/callback | head -1
HTTP/2 400
curl -sI https://login.k8s.example.com/ | head -1
HTTP/2 200
RBAC ืงืึทื ืคืืืืขืจืืืฉืึทื
ืืืจ ืฉืึทืคึฟื ืึท ืงืืึทืกืืขืจืจืึธืืข ืคึฟืึทืจ ืื ืืจืืคึผืข, ืืื ืืื ืืืขืจ ืคืึทื ืืื ืืืืื ืืืืขื ืขื ืึทืงืกืขืก:
cat << EOF | kubectl create -f -
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
name: cluster-read-all
rules:
-
apiGroups:
- ""
- apps
- autoscaling
- batch
- extensions
- policy
- rbac.authorization.k8s.io
- storage.k8s.io
resources:
- componentstatuses
- configmaps
- cronjobs
- daemonsets
- deployments
- events
- endpoints
- horizontalpodautoscalers
- ingress
- ingresses
- jobs
- limitranges
- namespaces
- nodes
- pods
- pods/log
- pods/exec
- persistentvolumes
- persistentvolumeclaims
- resourcequotas
- replicasets
- replicationcontrollers
- serviceaccounts
- services
- statefulsets
- storageclasses
- clusterroles
- roles
verbs:
- get
- watch
- list
- nonResourceURLs: ["*"]
verbs:
- get
- watch
- list
- apiGroups: [""]
resources: ["pods/exec"]
verbs: ["create"]
EOF
ืืึธืืืจ ืืึทืื ืึท ืงืึทื ืคืืืืขืจืืืฉืึทื ืคึฟืึทืจ ClusterRoleBinding:
cat <<EOF | kubectl create -f -
apiVersion: rbac.authorization.k8s.io/v1beta1
kind: ClusterRoleBinding
metadata:
name: dex-cluster-auth
namespace: kube-system
roleRef:
apiGroup: rbac.authorization.k8s.io
kind: ClusterRole
name: cluster-read-all
subjects:
kind: Group
name: "super-org:team-red"
EOF
ืืืฆื ืืืจ ืืขื ืขื ืืจืืื ืคึฟืึทืจ ืืขืกืืื ื.
ืืขืกืฅ
ืืืื ืฆื ืื ืืึธืืื ืืืึทื (https://login.k8s.example.com
) ืืื ืงืืึธืฅ ืืื ืืื ืืืื GitHub ืืฉืืื:
ืืึธืืื ืืืึทื
ืืึธืืื ืืืึทื ืจืืืขืจืขืงืืื ืฆื GitHub
ืืื ืื ืืืฉืขื ืขืจืืืืึทื ืื ืกืืจืึทืงืฉืึทื ื ืฆื ืืึทืงืืืขื ืึทืงืกืขืก
ื ืึธื ืงืึธืคึผืืข-ืคึผืึทืกืืื ื ืคืื ืื ืืืขื ืืืึทื, ืืืจ ืงืขื ืขื ื ืืฆื kubectl ืฆื ืคืืจื ืืื ืืืขืจ ืงื ืืื ืจืขืกืืจืกื:
kubectl get po
NAME READY STATUS RESTARTS AGE
mypod 1/1 Running 0 3d
kubectl delete po mypod
Error from server (Forbidden): pods "mypod" is forbidden: User "[email protected]" cannot delete pods in the namespace "default"
ืืื ืขืก ืึทืจืืขื, ืึทืืข GitHub ืืืืขืจื ืืื ืืื ืืืขืจ ืึธืจืืึทื ืืืึทืฆืืข ืงืขื ืขื ืืขื ืจืขืกืืจืกื ืืื ืึทืจืืึทื ืืึธืืืจื ืืื ืคึผืึธืืก, ืึธืืขืจ ืืื ืืึธื ื ืื ืืึธืื ืจืขืื ืฆื ืืืืฉื ืืื.
ืืงืืจ: www.habr.com