[Bug]: [HELM] Only one secret can be used despite multiple servers specified

[zemin-piao]

What is your environment, configuration, and command?

In the values.yaml, it is possible to specify multiple spark history servers in different profiles, via config.servers. However, currently only one secret is created and set as environment variable, for authenticating spark history server. In case authentication credentials are different among different spark history servers, the mcp-apache-spark-history-server using helm chart can only authenticate on one spark-history server.

What did you do and What did you see instead?

In the values.yaml:

config:
  port: 18888
  debug: false

  servers:
    default:
      default: true
      url: "http://spark-history-server:18080"
    staging:
      url: "http://staging-spark-history:18080"

auth:
  enabled: true

  # secret: use Kubernetes Secret to store spark history server credentials as environment variables
  secret:
    create: true
    name: "abc"
    username: "username"
    password: "password"
    token: "token"

Given only one credential can be specified, eventually mcp-apache-spark-history-server using this helm chart can only authenticate either default or staging

Additional Information. Logs.

No response

[Madhurchandran]

Hi @zemin-piao, I’d like to work on this issue.

[zemin-piao]

@nabuskey could you help assignment of this issue, cheers