Load balancer for Kube-API Kubernetes in VPC

[leduyquy]

ISSUE TYPE

• Bug Report
• Feature Idea

COMPONENT NAME

VPC, Kubernetes, Load Balancer 

CLOUDSTACK VERSION

 4.19.0.1 

CONFIGURATION

Create VPC 
Create Guest Network in VPC 
Create Kubernetes Cluster in Guest Network

OS / ENVIRONMENT

KVM and VMware host 

SUMMARY

Create Kubernetes in VPC. IP public access to KubeAPI use Forward rule not Load balancing

STEPS TO REPRODUCE

Without VPC

In VPC:

EXPECTED RESULTS

 Load balancer for Kube-API running on VPC

ACTUAL RESULTS

Public IP forward to only one control node, when it down, Disconnect to cluster

[boring-cyborg]

Thanks for opening your first issue here! Be sure to follow the issue template!

[weizhouapache]

This issue is similar as #8295, which has been addressed by #7919 in main/4.20 branch

cloudstack/plugins/integrations/kubernetes-service/src/main/java/com/cloud/kubernetes/cluster/actionworkers/KubernetesClusterResourceModifierActionWorker.java

Lines 762 to 777 in c6d3f6e

	NetworkOffering offering = networkOfferingDao.findById(network.getNetworkOfferingId());
	if (offering.isConserveMode()) {
	// Add load balancing for API access
	try {
	provisionLoadBalancerRule(publicIp, network, owner, clusterVMIds, CLUSTER_API_PORT);
	} catch (InsufficientAddressCapacityException e) {
	throw new ManagementServerException(String.format("Failed to activate API load balancing rules for the Kubernetes cluster : %s", kubernetesCluster.getName()), e);
	}
	} else {
	// Add port forwarding for API access
	try {
	provisionPublicIpPortForwardingRule(publicIp, network, owner, clusterVMIds.get(0), CLUSTER_API_PORT, CLUSTER_API_PORT);
	} catch (ResourceUnavailableException | NetworkRuleConflictException e) {
	throw new ManagementServerException(String.format("Failed to activate API port forwarding rules for the Kubernetes cluster : %s", kubernetesCluster.getName()), e);
	}
	}

if we need this in 4.19, #8308 can be re-opened

[DaanHoogland]

@leduyquy can you check this on main branch, as @weizhouapache suggested?
thanks

[weizhouapache]

this duplicates #8295 , which has been fixed in main/4.20

@leduyquy
can you please test the nightly build ?
https://download.cloudstack.org/testing/nightly/latest/