Questions tagged [amazon-eks]
Amazon Elastic Kubernetes Service (EKS) is a part of Amazon Web Services (AWS) and provides a fully managed Kubernetes platform, with the ability to have your containers deployed across a EC2 backed solution or as a serverless solution with AWS Fargate. Use this tag for programming-related questions specific to the EKS environment.
3,868
questions
77
votes
24
answers
139k
views
CircleCI message "error: exec plugin: invalid apiVersion "client.authentication.k8s.io/v1alpha1"
I am facing an error while deploying deployment in CircleCI. Please find the configuration file below.
When running the kubectl CLI, we got an error between kubectl and the EKS tool of the aws-cli.
...
- 889
45
votes
3
answers
66k
views
How to list all namespaces in a cluster?
I am trying to figure out how to list all namespaces in a cluster:
https://kubernetes.io/docs/concepts/overview/working-with-objects/namespaces/
something like:
kubectl describe cluster --namepaces -...
user11810894
40
votes
13
answers
52k
views
kubectl versions Error: exec plugin is configured to use API version client.authentication.k8s.io/v1alpha1
I was setting up my new Mac for my eks environment.
After the installation of kubectl, aws-iam-authenticator and the kubeconfig file placement in default location. I ran the command kubectl command ...
- 625
38
votes
5
answers
58k
views
Pod limit on Node - AWS EKS
On AWS EKS
I'm adding deployment with 17 replicas (requesting and limiting 64Mi memory) to a small cluster with 2 nodes type t3.small.
Counting with kube-system pods, total running pods per node is ...
- 14.2k
37
votes
4
answers
10k
views
kubectl context vs cluster
In the world of kubectl and kubernetes config, what's the difference between context and a cluster? For example I see these commands:
Available Commands:
current-context Displays the current-...
user7898461
35
votes
7
answers
49k
views
EKS ALB is not to able to auto-discover subnets
Background:
I have a VPC with 3 public subnets(the subnets have access to an internet gateway)
I have an EKS Cluster in this VPC, the EKS cluster is created from the console and not using eksctl
I ...
- 849
34
votes
6
answers
110k
views
Kubernetes Pods Terminated - Exit Code 137
I need some advise on an issue I am facing with k8s 1.14 and running gitlab pipelines on it. Many jobs are throwing up exit code 137 errors and I found that it means that the container is being ...
- 758
34
votes
12
answers
56k
views
AWS EKS NodeGroup "Create failed": Instances failed to join the kubernetes cluster
I am able to create an EKS cluster but when I try to add nodegroups, I receive a "Create failed" error with details:
"NodeCreationFailure": Instances failed to join the kubernetes ...
- 1,002
32
votes
1
answer
27k
views
How to use Docker Image in ECR with AWS EKS
I have created EKS Cluster. I also have docker image in ECR. I am not sure how to use the docker image in pod definition in YAML.
Is it required to give credentials in secret? or EKS IAM role should ...
- 764
31
votes
8
answers
61k
views
The connection to the server localhost:8080 was refused - did you specify the right host or port?
when i am trying to test the configuration of kubectl
kubectl get svc
i am getting this
error: the server doesn't have a resource type "svc"
when I try this command
kubectl get services
...
- 451
28
votes
9
answers
39k
views
Terraform: Error: Kubernetes cluster unreachable: invalid configuration
After deleting kubernetes cluster with "terraform destroy" I can't create it again anymore.
"terraform apply" returns the following error message:
Error: Kubernetes cluster ...
- 1,362
28
votes
6
answers
66k
views
How do you get kubectl to log in to an AWS EKS cluster?
Starting from a ~empty AWS account, I am trying to follow https://docs.aws.amazon.com/eks/latest/userguide/getting-started.html
So that meant I created a VPS stack, then installed aws-iam-...
- 1,221
27
votes
8
answers
35k
views
DNS problem on AWS EKS when running in private subnets
I have an EKS cluster setup in a VPC. The worker nodes are launched in private subnets. I can successfully deploy pods and services.
However, I'm not able to perform DNS resolution from within the ...
- 995
25
votes
7
answers
39k
views
Your current user or role does not have access to Kubernetes objects on this EKS cluster
Don't know if this is an error from AWS or something. I created an IAM user and gave it full admin policies. I then used this user to create an EKS cluster using the eksctl CLI but when I logging to ...
- 375
25
votes
4
answers
14k
views
What does "eksctl create iamserviceaccount" do under the hood on an EKS cluster?
AWS supports IAM Roles for Service Accounts (IRSA) that allows cluster operators to map AWS IAM Roles to Kubernetes Service Accounts.
To do so, one has to create an iamserviceaccount in an EKS cluster:...
- 1,326
25
votes
8
answers
92k
views
couldn't get current server API group list: the server has asked for the client to provide credentials error: You must be logged in to the server
I created the eks cluster trying to connect it with local cli, for that, I installed the aws-cli and also provide the right 'aws configure' credentials. The user which I am using to connect with the ...
- 521
24
votes
3
answers
21k
views
How to rewrite target url within an AWS ALB Ingress Controller?
In a classic Kubernetes Nginx ingress I know that it is possible to rewrite target url based on a specific regex by appling this annotation nginx.ingress.kubernetes.io/rewrite-target: /$1
But this ...
- 1,223
23
votes
7
answers
97k
views
"The connection to the server localhost:8080 was refused - did you specify the right host or port?"
I'm on an ec2 instance trying to get my cluster created. I have kubectl already installed and here are my services and workloads yaml files
services.yaml
apiVersion: v1
kind: Service
metadata:
name: ...
- 683
21
votes
4
answers
26k
views
AccessDeniedException - creating eks cluster - User is not authorized to perform: eks:CreateCluster
I am trying to run this command at the command line:
aws eks create-cluster \
--name ignitecluster \
--role-arn "$role_arn" \
--resources-vpc-config \
subnetIds="$...
- 95.5k
20
votes
1
answer
22k
views
PersistentVolumeClaim is stuck 'waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com"' on new AWS EKS cluster
We have a EKS setup provisioned where we use a Cloud Native Buildpacks based Tekton Pipeline our PipelineRuns are stuck and pending forever without getting a Pod resource. We created a ...
- 13.5k
20
votes
4
answers
32k
views
How to stop AWS EKS Worker Instances
I wonder if that would be possible to temporary stop the worker VM instances so they are not running at night time when I am not working on a cluster development. So far the only way I am aware of to "...
- 18.7k
20
votes
2
answers
6k
views
KOPS over AWS EKS or vice versa
I came across an open source Kubernetes project KOPS and AWS Kubernetes service EKS. Both these products allow installation of a Kubernetes cluster. However, I wonder why one would pick EKS over KOPS ...
- 5,854
20
votes
2
answers
9k
views
custom tag on EBS volume provisioned dynamically by Kubernetes
I'm dynamically provisioning a EBS Volume (Kubernetes on AWS through EKS) through PersistentVolumeClaim with a StorageClass
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
name: k8sebs
...
- 2,178
20
votes
1
answer
21k
views
Pods stuck in ContainerCreating with "failed to assign an IP address to container"
Multiple pods of a 600 pod deployment stuck in ContainerCreating after a rolling update with the message:
Failed create pod sandbox: rpc error: code = Unknown desc =
NetworkPlugin cni failed to ...
- 2,240
19
votes
1
answer
14k
views
EKS in private Subnet , Load Balancer in public subnet
I am running EKS in private subnet and thus unable to create an internet facing load balancer but was able to create Internal LoadBalancer.
Is there any way I can create Loadbalancer(probably ...
- 1,128
18
votes
7
answers
38k
views
EKS : could not find any suitable subnets for creating the ELB
I am trying to expose a service to the outside world using the loadBalancer type service.
For that, i have followed this doc
https://aws.amazon.com/premiumsupport/knowledge-center/eks-kubernetes-...
- 5,706
18
votes
1
answer
27k
views
Getting error "An error occurred (AccessDenied) when calling the AssumeRole operation: Access denied" after setting up EKS cluster
I have created the EKS cluster using AWS console, while creating a cluster I used my pre-created VPCs and subnets, I have created one role eks-role which has AmazonEKSClusterPolicy and ...
- 327
18
votes
5
answers
26k
views
kubectl logs -f gets "Authorization error"
I recently created a cluster on EKS with eksctl. kubectl logs -f mypod-0 bumps into Authorization error:
Error from server (InternalError): Internal error occurred: Authorization error (user=kube-...
- 3,595
18
votes
5
answers
30k
views
failed to garbage collect required amount of images. Wanted to free 6283487641 bytes, but freed 0 bytes
I have searched many websites and articles but not found any perfect answer. I am using eks version 1.18. I can see a few of the pods are "Evicted", but when trying to check the node I can ...
- 6,359
17
votes
3
answers
28k
views
Unable to connect to the server: getting credentials: decoding stdout: no kind "ExecCredential" is registered for version [closed]
**Unable to connect to the server: getting credentials: decoding stdout: no kind "ExecCredential" is registered for version "client.authentication.k8s.io/v1alpha1" in scheme "...
17
votes
2
answers
14k
views
Use ECR images in EKS from another account
I've two accounts: Account A and Account B. I would like to run an image from ECR at Account A on EKS on Account B.
I'm a bit confused on how to give the EKS the permissions.
At first I thought of ...
- 173
16
votes
6
answers
60k
views
how to redirect http to https using a kubernetes ingress controller on Amazon EKS
I have configured amazon certificate manager, ALB Ingress Controller and a domain names for my application. I can access my application through port 80 and port 443 (all certificates works just fine). ...
- 947
16
votes
4
answers
10k
views
Setting up AWS EKS - Don't know username and password for config
I'm having an extremely hard time setting up EKS on AWS. I've followed this tutorial: https://docs.aws.amazon.com/eks/latest/userguide/getting-started.html#eks-launch-workers
I got up to the ~/.kube/...
- 301
16
votes
2
answers
16k
views
AWS EKS - Only 2 pod can be launched - Too many pods error
Each t2.micro node should be able to run 4 pods according to this article and the command kubectl get nodes -o yaml | grep pods output.
But I have two nodes and I can launch only 2 pods. 3rd pod gets ...
- 2,795
16
votes
2
answers
16k
views
Can kubectl work from an assumed role from AWS
I'm using Amazon EKS for Kubernetes deployment (initially created by an AWS admin user), and currently having difficulty to use the AWS credentials from AWS STS assume-role to execute kubectl commands ...
- 161
16
votes
2
answers
12k
views
Kubernetes: Have no access from EKS pod to RDS Postgres
I'm trying to setup kubernetes on AWS. For this I created an EKS cluster with 3 nodes (t2.small) according to official AWS tutorial. Then I want to run a pod with some app which communicates with ...
- 2,986
15
votes
7
answers
46k
views
InvalidClientTokenId: The security token included in the request is invalid. status code: 403
I am using, terraform & kubectl to deploy insfra-structure and application.
Since I changed aws configure :
terraform init
terraform apply
I always got :
terraform apply
Error: error ...
- 11k
15
votes
1
answer
20k
views
Rate Limiting based on URL and Path in Kubernetes
I need to implement Rate Limiting (based on URL and path) on applications deployed on Kubernetes Cluster (EKS).
I'm looking for a managed way that involves least scripting and does provide an ...
- 151
15
votes
4
answers
22k
views
How can I assign a static IP to my EKS service?
I have an EKS cluster.
I created my service and exposed it using ingress-nginx.
ingress-nginx external IP appears as a DNS name and not as IP.
How can I connect my private domain to point to my EKS ...
- 5,273
15
votes
4
answers
33k
views
Not able to SSH EKS Worker Nodes
I have create EKS cluster as specified in
https://docs.aws.amazon.com/eks/latest/userguide/getting-started.html
Added worker nodes
as specified in above link Step 3: Launch and Configure Amazon EKS ...
- 764
15
votes
2
answers
5k
views
Get authentication token from AWS EKS using the AWS Java SDK v2
How can I get a Kubernetes authentication token from AWS EKS using the AWS Java SDK v2? An authentication token that can then be used to authenticate with Kubernetes using a Kubernetes SDK. In other ...
- 2,043
15
votes
12
answers
88k
views
Kubectl command throwing error: Unable to connect to the server: getting credentials: exec: exit status 2
I am doing a lab setup of EKS/Kubectl and after the completion cluster build, I run the following:
> kubectl get node
And I get the following error:
Unable to connect to the server: getting ...
14
votes
3
answers
11k
views
Switch terraform 0.12.6 to 0.13.0 gives me provider["registry.terraform.io/-/null"] is required, but it has been removed
I manage state in remote terraform-cloud
I have downloaded and installed the latest terraform 0.13 CLI
Then I removed the .terraform.
Then I ran terraform init and got no error
then I did
➜ terraform ...
- 9,828
14
votes
1
answer
13k
views
How do I pass variables to a yaml file in helm.tf?
I have a file for creating terraform resources with helm helm.tf.
In this file I create a honeycomb agent and need to pass in some watchers, so I'm using a yaml file for configuration. Here is the ...
- 1,265
14
votes
3
answers
12k
views
What's the maximum number of Kubernetes namespaces?
Is there a maximum number of namespaces supported by a Kubernetes cluster? My team is designing a system to run user workloads via K8s and we are considering using one namespace per user to offer ...
- 1,326
14
votes
2
answers
10k
views
Mistakenly updated configmap aws-auth with rbac & lost access to the cluster
Was trying to restrict IAM users with the rbac of AWS EKS cluster. Mistakenly updated the configmap "aws-auth" from kube-system namespace. This removed the complete access to the EKS cluster.
Missed ...
- 966
14
votes
5
answers
37k
views
Kubernetes autoscaler - NotTriggerScaleUp' pod didn't trigger scale-up (it wouldn't fit if a new node is added)
I'd like to run a 'job' per node, one pod on a node at a time.
I've scheduled a bunch of jobs
I have a whole bunch of pending pods now
I'd like these pending pods to now trigger a node scaling up ...
- 31.9k
14
votes
4
answers
7k
views
Error loading Namespaces. Unauthorized: Verify you have access to the Kubernetes cluster
I have created a EKS cluster using the the command line eksctl and verified that the application is working fine.
But noticing a strange issue, when i try yo access the nodes in the cluster in the web ...
- 2,842
14
votes
1
answer
8k
views
Terraform: Deploying a Docker Compose app on EKS/ECS
TL;DR
I use an open-source server application running on Docker Compose. It has a few services, including PostgreSQL DB and Redis.
How can I best deploy this application to AWS in full IaC with ...
- 710
14
votes
2
answers
9k
views
How to get k8s master logs on EKS?
I am looking for these logs:
/var/log/kube-apiserver.log
/var/log/kube-scheduler.log
/var/log/kube-controller-manager.log
In EKS user does not have access to the control plane and can't see these ...
- 537