expand/awx-on-k3s
1
0
Fork 0
mirror of https://github.com/Expand-sys/awx-on-k3s synced 2025-12-16 05:52:15 +11:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix: update each tool to the latest version

Browse source
This commit is contained in:
kurokobo 2022-02-04 22:45:52 +09:00
parent 17254768a8
commit a3fb4acd5c
13 changed files with 231 additions and 206 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
acme/README.md
View file

@ -42,7 +42,7 @@ This guide does not provide any information how to configure Azure, other DNS se
Deploy cert-manager first.
```bash
kubectl apply -f https://github.com/jetstack/cert-manager/releases/download/v1.6.1/cert-manager.yaml
kubectl apply -f https://github.com/jetstack/cert-manager/releases/download/v1.7.0/cert-manager.yaml
```
Ensure the pods in `cert-manager` namespace are running.

4
builder/README.md
View file

@ -5,9 +5,9 @@
## Environment in This Example
- CentOS 8.2
- CentOS Stream 8 (Minimal)
- Python 3.9
- Docker 20.10.7
- Docker 20.10.12
## Install

237
galaxy/README.md
View file

@ -20,8 +20,9 @@ All information on this page is for **development, testing and study purposes on
- [Deploy Galaxy NG](#deploy-galaxy-ng)
- [Initial Configuration](#initial-configuration)
- [Deploy on Kubernetes (Pulp Operator)](#deploy-on-kubernetes-pulp-operator)
- [Preparation](#preparation-1)
- [Deploy Pulp Operator](#deploy-pulp-operator)
- [Patch K3s](#patch-k3s)
- [Install Pulp Operator](#install-pulp-operator)
- [Prepare required files](#prepare-required-files)
- [Deploy Galaxy NG](#deploy-galaxy-ng-1)
- [Configuration and Usage](#configuration-and-usage)
- [Sync Collections with Public Galaxy](#sync-collections-with-public-galaxy)
@ -117,6 +118,18 @@ Modify `hosts` and `host` in `all-in-one/ingress.yaml`.
...
```
Modify FQDNs in `all-in-one/configmap.yaml`.
```yaml
...
data:
settings.py: |-
CONTENT_ORIGIN='https://galaxy.example.com' 👈👈👈
ANSIBLE_API_HOSTNAME='https://galaxy.example.com' 👈👈👈
ANSIBLE_CONTENT_HOSTNAME='https://galaxy.example.com/pulp/content' 👈👈👈
TOKEN_AUTH_DISABLED=True
```
Prepare directories for Persistent Volumes defined in `all-in-one/pv.yaml`.
```bash
@ -167,32 +180,104 @@ There is a Kubernetes Operator for Pulp 3 named Pulp Operator.
- [pulp/pulp-operator: Kubernetes Operator for Pulp 3](https://github.com/pulp/pulp-operator)
This project is still under active development and there is no support, however, at least the code to create a new instance seems to be implemented. In this procedure, we use [Pulp Operator 0.3.0](https://github.com/pulp/pulp-operator/tree/0.3.0)
This project is still under active development and there is no support, however, at least the code to create a new instance seems to be implemented. In this procedure, we use [Pulp Operator 0.7.0](https://github.com/pulp/pulp-operator/tree/0.7.0)
### Preparation
### Patch K3s
If you use Traefik which is K3s' Ingress controller as completely default, the Pod may not be able to get the client's IP address (see [k3s-io/k3s#2997](https://github.com/k3s-io/k3s/discussions/2997) for detail). In the current implementation of Pulp, this causes problems with the web UI being unreachable.
For this reason, fix the Traefik configuration. For a single node like doing in this repository, the following command is easy to use.
```bash
kubectl -n kube-system patch deployment traefik --patch '{"spec":{"template":{"spec":{"hostNetwork":true}}}}'
```
Then wait until your `traefik` by the following command is `1/1` `READY`.
```bash
kubectl -n kube-system get deployment traefik
```
Now your client's IP address can be passed correctly through X-Forwarded-For and X-Real-Ip headers.
### Install Pulp Operator
Install specified version of Pulp Operator.
```bash
cd ~
git clone https://github.com/pulp/pulp-operator.git
cd pulp-operator
git checkout 0.7.0
```
Export `NAMESPACE` environment variable with `pulp-operator-system`, and then deploy Pulp Operator by `make deploy`. Note that the namespace where Pulp operator will be deployed can be changed by `NAMESPACE` environment variable, but some resources have hard-coded namespace with `pulp-operator-system` that do not work well.
```bash
export NAMESPACE=pulp-operator-system
make deploy
```
The Pulp Operator will be deployed to the namespace you specified.
```bash
$ kubectl -n pulp-operator-system get all
NAME READY STATUS RESTARTS AGE
pod/pulp-operator-controller-manager-9b8644f46-rg2rl 2/2 Running 0 21s
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
service/pulp-operator-controller-manager-metrics-service ClusterIP 10.43.20.233 <none> 8443/TCP 21s
NAME READY UP-TO-DATE AVAILABLE AGE
deployment.apps/pulp-operator-controller-manager 1/1 1 1 21s
NAME DESIRED CURRENT READY AGE
replicaset.apps/pulp-operator-controller-manager-9b8644f46 1 1 1 21s
```
### Prepare required files
Clone this repository and change directory.
```bash
cd ~
git clone https://github.com/kurokobo/awx-on-k3s.git
cd awx-on-k3s/galaxy
```
Generate a Self-Signed Certificate and key pair. Note that IP address can't be specified.
```bash
GALAXY_HOST="galaxy.example.com"
openssl req -x509 -nodes -days 3650 -newkey rsa:2048 -out ./galaxy/galaxy/tls.crt -keyout ./galaxy/galaxy/tls.key -subj "/CN=${GALAXY_HOST}/O=${GALAXY_HOST}" -addext "subjectAltName = DNS:${GALAXY_HOST}"
openssl req -x509 -nodes -days 3650 -newkey rsa:2048 -out ./pulp/tls.crt -keyout ./pulp/tls.key -subj "/CN=${GALAXY_HOST}/O=${GALAXY_HOST}" -addext "subjectAltName = DNS:${GALAXY_HOST}"
```
Modify `hostname` in `galaxy/galaxy.yaml`.
Modify `hostname` in `pulp/galaxy.yaml`.
```yaml
...
spec:
...
route_host: galaxy.example.com 👈👈👈
ingress_type: ingress
ingress_tls_secret: galaxy-secret-tls
hostname: galaxy.example.com 👈👈👈
...
```
Modify `password`s in `galaxy/kustomization.yaml`.
Modify two `password`s in `pulp/kustomization.yaml`.
```yaml
...
- name: galaxy-postgres-configuration
type: Opaque
literals:
- host=galaxy-postgres
- port=5432
- database=galaxy
- username=galaxy
- password=Galaxy123! 👈👈👈
- type=managed
- name: galaxy-admin-password
type: Opaque
literals:
@ -200,107 +285,98 @@ Modify `password`s in `galaxy/kustomization.yaml`.
...
```
Prepare directories for Persistent Volumes defined in `galaxy/pv.yaml`.
Prepare directories for Persistent Volumes defined in `pulp/pv.yaml`.
```bash
sudo mkdir -p /data/galaxy/pulp
sudo mkdir -p /data/galaxy/postgres
```
### Deploy Pulp Operator
Deploy Pulp Operator.
```bash
kubectl apply -k galaxy/operator
```
Ensure that your Operator is running in `galaxy` namespace.
```bash
$ kubectl -n galaxy get all
NAME READY STATUS RESTARTS AGE
pod/pulp-operator-75668bb8c-gcj2t 1/1 Running 0 61s
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
service/pulp-operator-metrics ClusterIP 10.43.205.91 <none> 8383/TCP,8686/TCP 55s
NAME READY UP-TO-DATE AVAILABLE AGE
deployment.apps/pulp-operator 1/1 1 1 61s
NAME DESIRED CURRENT READY AGE
replicaset.apps/pulp-operator-75668bb8c 1 1 1 61s
sudo mkdir -p /data/galaxy/redis
sudo mkdir -p /data/galaxy/pulp
```
### Deploy Galaxy NG
Finally deploy Galaxy NG.
Deploy Galaxy NG.
```bash
kubectl apply -k galaxy/galaxy
kubectl apply -k pulp
```
If you got an error `error: unable to recognize "galaxy/operator": no matches for kind "Pulp" in version "pulp.pulpproject.org/v1beta1"`, simply invoke same command again. This is timing issue.
To monitor the progress of the deployment, check the logs of `deployments/awx-operator-controller-manager`:
Once this completed, the logs of `deployment/pulp-operator` in `galaxy` namespace end with:
```bash
kubectl -n pulp-operator-system logs -f deployments/pulp-operator-controller-manager -c pulp-manager
```
When the deployment completes successfully, the logs end with:
```txt
$ kubectl -n galaxy logs -f deployment/pulp-operator
$ kubectl -n pulp-operator-system logs -f deployments/pulp-operator-controller-manager -c pulp-manager
...
--------------------------- Ansible Task Status Event StdOut -----------------
----- Ansible Task Status Event StdOut (pulp.pulpproject.org/v1beta1, Kind=Pulp, galaxy/pulp-operator-system) -----
PLAY RECAP *********************************************************************
localhost : ok=51 changed=0 unreachable=0 failed=0 skipped=47 rescued=0 ignored=0
-------------------------------------------------------------------------------
localhost : ok=75 changed=0 unreachable=0 failed=0 skipped=62 rescued=0 ignored=0
```
And everything related to Galaxy NG are deployed in `galaxy` namespace.
Required objects has been deployed next to Pulp Operator in `pulp-operator-system` namespace.
```bash
$ kubectl -n galaxy get pulp,all,ingress,secrets
$ kubectl -n pulp-operator-system get pulp,all,ingress,secrets
NAME AGE
pulp.pulp.pulpproject.org/galaxy 3m58s
NAME READY STATUS RESTARTS AGE
pod/pulp-operator-75668bb8c-kcwzc 1/1 Running 0 3m53s
pod/galaxy-postgres-0 1/1 Running 0 3m14s
pod/galaxy-redis-6fd7f7dd44-5l7gw 1/1 Running 0 3m10s
pod/galaxy-content-77d89f4c46-5f7s7 1/1 Running 0 2m55s
pod/galaxy-resource-manager-74895b7b5-hfq6w 1/1 Running 0 2m54s
pod/galaxy-worker-7c8ff54785-9twwg 1/1 Running 0 2m53s
pod/galaxy-api-7845d86d77-gwt84 1/1 Running 0 2m57s
pod/galaxy-web-776cccc64-hxp4f 1/1 Running 2 3m8s
pod/pulp-operator-controller-manager-9b8644f46-plw72 2/2 Running 0 4m37s
pod/galaxy-redis-65c899f464-c6dhb 1/1 Running 0 3m50s
pod/galaxy-postgres-0 1/1 Running 0 3m53s
pod/galaxy-content-76f68bb68f-6tn2q 1/1 Running 0 3m37s
pod/galaxy-worker-76c986fd54-qjg28 1/1 Running 0 3m36s
pod/galaxy-api-76985868c8-vjwks 1/1 Running 0 3m39s
pod/galaxy-web-67cc96d8d6-644dh 1/1 Running 0 3m48s
pod/galaxy-resource-manager-64dbf49746-jcsfs 1/1 Running 0 118s
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
service/pulp-operator-metrics ClusterIP 10.43.64.53 <none> 8383/TCP,8686/TCP 3m48s
service/galaxy-postgres ClusterIP None <none> 5432/TCP 3m14s
service/galaxy-redis ClusterIP 10.43.193.92 <none> 6379/TCP 3m11s
service/galaxy-web-svc ClusterIP 10.43.21.92 <none> 24880/TCP 3m7s
service/galaxy-api-svc ClusterIP 10.43.148.168 <none> 24817/TCP 2m58s
service/galaxy-content-svc ClusterIP 10.43.151.55 <none> 24816/TCP 2m56s
service/pulp-operator-controller-manager-metrics-service ClusterIP 10.43.173.114 <none> 8443/TCP 4m37s
service/galaxy-postgres-svc ClusterIP None <none> 5432/TCP 3m53s
service/galaxy-redis-svc ClusterIP 10.43.29.57 <none> 6379/TCP 3m51s
service/galaxy-web-svc ClusterIP 10.43.245.204 <none> 24880/TCP 3m47s
service/galaxy-api-svc ClusterIP 10.43.146.254 <none> 24817/TCP 3m40s
service/galaxy-content-svc ClusterIP 10.43.214.64 <none> 24816/TCP 3m38s
NAME READY UP-TO-DATE AVAILABLE AGE
deployment.apps/pulp-operator 1/1 1 1 3m53s
deployment.apps/galaxy-redis 1/1 1 1 3m10s
deployment.apps/galaxy-content 1/1 1 1 2m55s
deployment.apps/galaxy-resource-manager 1/1 1 1 2m54s
deployment.apps/galaxy-worker 1/1 1 1 2m53s
deployment.apps/galaxy-api 1/1 1 1 2m57s
deployment.apps/galaxy-web 1/1 1 1 3m8s
deployment.apps/pulp-operator-controller-manager 1/1 1 1 4m37s
deployment.apps/galaxy-redis 1/1 1 1 3m50s
deployment.apps/galaxy-content 1/1 1 1 3m37s
deployment.apps/galaxy-worker 1/1 1 1 3m36s
deployment.apps/galaxy-api 1/1 1 1 3m39s
deployment.apps/galaxy-web 1/1 1 1 3m48s
deployment.apps/galaxy-resource-manager 1/1 1 1 118s
NAME DESIRED CURRENT READY AGE
replicaset.apps/pulp-operator-75668bb8c 1 1 1 3m53s
replicaset.apps/galaxy-redis-6fd7f7dd44 1 1 1 3m10s
replicaset.apps/galaxy-content-77d89f4c46 1 1 1 2m55s
replicaset.apps/galaxy-resource-manager-74895b7b5 1 1 1 2m54s
replicaset.apps/galaxy-worker-7c8ff54785 1 1 1 2m53s
replicaset.apps/galaxy-api-7845d86d77 1 1 1 2m57s
replicaset.apps/galaxy-web-776cccc64 1 1 1 3m8s
replicaset.apps/pulp-operator-controller-manager-9b8644f46 1 1 1 4m37s
replicaset.apps/galaxy-redis-65c899f464 1 1 1 3m50s
replicaset.apps/galaxy-content-76f68bb68f 1 1 1 3m37s
replicaset.apps/galaxy-worker-76c986fd54 1 1 1 3m36s
replicaset.apps/galaxy-api-76985868c8 1 1 1 3m39s
replicaset.apps/galaxy-web-67cc96d8d6 1 1 1 3m48s
replicaset.apps/galaxy-resource-manager-64dbf49746 1 1 1 118s
NAME READY AGE
statefulset.apps/galaxy-postgres 1/1 3m14s
statefulset.apps/galaxy-postgres 1/1 3m53s
NAME AGE
pulp.pulp.pulpproject.org/galaxy 3m22s
NAME CLASS HOSTS ADDRESS PORTS AGE
ingress.networking.k8s.io/galaxy-ingress <none> galaxy.example.com 192.168.0.100 80, 443 3m50s
NAME TYPE DATA AGE
secret/default-token-vsnlj kubernetes.io/service-account-token 3 4m37s
secret/pulp-operator-sa-token-smzj2 kubernetes.io/service-account-token 3 4m37s
secret/galaxy-admin-password Opaque 1 3m58s
secret/galaxy-postgres-configuration Opaque 6 3m58s
secret/galaxy-secret-tls kubernetes.io/tls 2 3m58s
secret/galaxy-server Opaque 1 3m44s
secret/galaxy-db-fields-encryption Opaque 1 3m41s
```
Now Galaxy NG is available at `https://galaxy.example.com/` or the hostname you specified.
Now your AWX is available at `https://galaxy.example.com/` or the hostname you specified. You can log in to the GUI by user `admin` with password you specified in `pulp/kustomization.yaml`.
## Configuration and Usage
@ -342,6 +418,13 @@ Create a new minimal collection with a minimal plugin, minimal module, and minim
# Create skeleton collection
ansible-galaxy collection init demo.collection
# Create meta file
mkdir -p demo/collection/meta
cat <<EOF > demo/collection/meta/runtime.yml
---
requires_ansible: "<=2.10"
EOF
# Create new Plugin
mkdir -p demo/collection/plugins/vars
cat <<EOF > demo/collection/plugins/vars/sample_vars.py

5
galaxy/galaxy/namespace.yaml
View file

@ -1,5 +0,0 @@
---
apiVersion: v1
kind: Namespace
metadata:
name: galaxy

11
galaxy/operator/clusterrolebinding.yaml
View file

@ -1,11 +0,0 @@
kind: ClusterRoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
name: pulp-operator
subjects:
- kind: ServiceAccount
name: pulp-operator
roleRef:
kind: ClusterRole
name: pulp-operator
apiGroup: rbac.authorization.k8s.io

18
galaxy/operator/kustomization.yaml
View file

@ -1,18 +0,0 @@
---
apiVersion: kustomize.config.k8s.io/v1beta1
kind: Kustomization
namespace: galaxy
resources:
- namespace.yaml
- https://raw.githubusercontent.com/pulp/pulp-operator/0.3.0/deploy/crds/pulpproject_v1beta1_pulp_crd.yaml
- https://raw.githubusercontent.com/pulp/pulp-operator/0.3.0/deploy/crds/pulpproject_v1beta1_pulpbackup_crd.yaml
- https://raw.githubusercontent.com/pulp/pulp-operator/0.3.0/deploy/crds/pulpproject_v1beta1_pulprestore_crd.yaml
- https://raw.githubusercontent.com/pulp/pulp-operator/0.3.0/deploy/service_account.yaml
- https://raw.githubusercontent.com/pulp/pulp-operator/0.3.0/deploy/cluster_role.yaml
- https://raw.githubusercontent.com/pulp/pulp-operator/0.3.0/deploy/role.yaml
- https://raw.githubusercontent.com/pulp/pulp-operator/0.3.0/deploy/role_binding.yaml
- clusterrolebinding.yaml
- operator.yaml

50
galaxy/operator/operator.yaml
View file

@ -1,50 +0,0 @@
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: pulp-operator
labels:
app.kubernetes.io/name: pulp-operator
app.kubernetes.io/component: operator
spec:
replicas: 1
selector:
matchLabels:
app.kubernetes.io/name: pulp-operator
app.kubernetes.io/component: operator
template:
metadata:
labels:
app.kubernetes.io/name: pulp-operator
app.kubernetes.io/component: operator
spec:
serviceAccountName: pulp-operator
containers:
- name: pulp-operator
image: "quay.io/pulp/pulp-operator:0.3.0"
imagePullPolicy: "IfNotPresent"
volumeMounts:
- mountPath: /tmp/ansible-operator/runner
name: runner
env:
- name: WATCH_NAMESPACE
valueFrom:
fieldRef:
fieldPath: metadata.namespace
- name: POD_NAME
valueFrom:
fieldRef:
fieldPath: metadata.name
- name: OPERATOR_NAME
value: "pulp-operator"
- name: ANSIBLE_GATHERING
value: explicit
livenessProbe:
httpGet:
path: /healthz
port: 6789
initialDelaySeconds: 15
periodSeconds: 20
volumes:
- name: runner
emptyDir: {}

12
galaxy/operator/rolebinding.yaml
View file

@ -1,12 +0,0 @@
kind: RoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
name: pulp-operator
roleRef:
apiGroup: rbac.authorization.k8s.io
kind: Role
name: pulp-operator
subjects:
- kind: ServiceAccount
name: pulp-operator
namespace: default

41
galaxy/galaxy/galaxy.yaml → galaxy/pulp/galaxy.yaml
View file

@ -3,26 +3,39 @@ kind: Pulp
metadata:
name: galaxy
spec:
ingress_type: Ingress
# These parameters are designed for use with:
# - Pulp Operator: 0.7.0
# https://github.com/pulp/pulp-operator/blob/0.7.0/README.md
# - Galaxy NG: 4.4.1
# https://github.com/ansible/galaxy_ng/tree/4.4.1
image: quay.io/pulp/galaxy
image_version: 4.4.1
image_web: quay.io/pulp/galaxy-web
image_web_version: 4.4.1
admin_password_secret: galaxy-admin-password
ingress_type: ingress
ingress_tls_secret: galaxy-secret-tls
route_host: galaxy.example.com
hostname: galaxy.example.com
image: galaxy
image_web: galaxy-web
tag: "0.3.0"
postgres_storage_class: galaxy-postgres-volume
postgres_storage_requirements:
requests:
storage: 2Gi
redis_storage_class: galaxy-redis-volume
storage_type: file
file_storage_storage_class: galaxy-pulp-volume
file_storage_access_mode: ReadWriteOnce
file_storage_size: 10Gi
pulp_settings:
GALAXY_FEATURE_FLAGS:
execution_environments: "True"
TOKEN_AUTH_DISABLED: "True"
admin_password_secret: galaxy-admin-password
storage_type: File
file_storage_storage_class: galaxy-pulp-volume
file_storage_access_mode: ReadWriteOnce
file_storage_size: 10Gi
postgres_storage_class: galaxy-postgres-volume
postgres_resource_requirements:
requests:
storage: 2Gi
api:
replicas: 1
content:

12
galaxy/galaxy/kustomization.yaml → galaxy/pulp/kustomization.yaml
View file

@ -1,7 +1,7 @@
---
apiVersion: kustomize.config.k8s.io/v1beta1
kind: Kustomization
namespace: galaxy
namespace: pulp-operator-system
generatorOptions:
disableNameSuffixHash: true
@ -13,6 +13,16 @@ secretGenerator:
- tls.crt
- tls.key
- name: galaxy-postgres-configuration
type: Opaque
literals:
- host=galaxy-postgres-svc
- port=5432
- database=galaxy
- username=galaxy
- password=Galaxy123!
- type=managed
- name: galaxy-admin-password
type: Opaque
literals:

2
galaxy/operator/namespace.yaml → galaxy/pulp/namespace.yaml
View file

@ -2,4 +2,4 @@
apiVersion: v1
kind: Namespace
metadata:
name: galaxy
name: pulp-operator-system

15
galaxy/galaxy/pv.yaml → galaxy/pulp/pv.yaml
View file

@ -27,3 +27,18 @@ spec:
storageClassName: galaxy-pulp-volume
hostPath:
path: /data/galaxy/pulp
---
apiVersion: v1
kind: PersistentVolume
metadata:
name: galaxy-redis-volume
spec:
accessModes:
- ReadWriteOnce
persistentVolumeReclaimPolicy: Retain
capacity:
storage: 1Gi
storageClassName: galaxy-redis-volume
hostPath:
path: /data/galaxy/redis

4
runner/README.md
View file

@ -5,9 +5,9 @@
## Environment in This Example
- CentOS 8.2
- CentOS Stream 8 (Minimal)
- Python 3.9
- Docker 20.10.7
- Docker 20.10.12
## Install