configer

configer

I wrote this package to have a quick and easy way to configure my personal projects. It uses viper as the configuration package under the hood, and the pflag library to work with flags.

Installation

To get the latest version, run

go get github.com/Ozoniuss/configer

Usage

Start by defining a structure for storing the project's overall configuration. The runtime configurations will be unmarshaled into an object of this struct when the project is started, which is passed on via dependency injection.

// Config holds the project's runtime configuration.
type Config struct {
	Server   Server
	Key      int
	Insecure bool
}

// Server defines the configuration options for the server.
type Server struct {
	Address string
	Port    int32
}

Use the configer ConfigOptions struct to specify the project's configuration options. Through the ConfigKey field, specify the field of the config struct the option is attached to:

// getProjectOpts returns all the configuration options enabled for the project.
func getProjectOpts() []cfg.ConfigOption {
	return []cfg.ConfigOption{
		{FlagName: "server-address", Shorthand: "", Value: "localhost", ConfigKey: "server.address",
			Usage: "The address on which the server is listening for connections."},
		{FlagName: "server-port", Shorthand: "", Value: 8080, ConfigKey: "server.port",
			Usage: "The server port opened for incoming connections."},
		{FlagName: "key", Shorthand: "k", Value: 123456, ConfigKey: "key",
			Usage: "The key required to access the server."},
		{FlagName: "insecure", Shorthand: "", Value: true, ConfigKey: "insecure",
			Usage: "Specify whether or not TLS is enabled."},
	}
}

Note that the ConfigKey has not been chosen randomly and has a special meaning. See this section for more details about config keys.

Create the config:

import (
	"fmt"
	cfg "github.com/Ozoniuss/configer"
)

func main() {
	var config Config

	parserOptions := []cfg.ParserOption{
		cfg.WithConfigName("config"),
		cfg.WithConfigType("yml"),
		cfg.WithConfigPath("."),
		cfg.WithConfigPath("./config"),
		cfg.WithEnvPrefix("DEMO"),
		cfg.WithEnvKeyReplacer("_"),
	}

	err := cfg.NewConfig(&config, getProjectOpts(), parserOptions...)
	if err != nil {
		fmt.Println("could not initialize config: %w", err)
		return
	}
	
	fmt.Printf("config: %+v", config)
}

Output:

config: {Server:{Address:localhost Port:8080} Key:123456 Insecure:true}

See the available config options:

$ ./main --help
Usage of main:
      --insecure                Specify whether or not TLS is enabled. (default true)
  -k, --key int                 The key required to access the server. (default 123456)
      --server-address string   The address on which the server is listening for connections. (default "localhost")
      --server-port int         The server port opened for incoming connections. (default 8080)

And you're all set. Specify config options via flags, environment variables, configuration files and default values, in this order of precedence.

$ DEMO_PORT=9090
$ ./main --key 100 --server-address 0.0.0.0
{Server:{Address:0.0.0.0 Port:9090} Key:100 Insecure:true}

Setting the config keys when defining project options

Note that ConfigKey tells the parser which struct field to assign the option to, when unmarshaling into a Config object. So for example if your config looks like this:

type Config struct {
	Val1 MyType1
}
type MyType1 struct {
	Val2 MyType2
}
type MyType2 struct {
	Val3 int
}

Then if you want to define a configuration option that unmarshals to the inner Val3 field of this config, you have to set its config key to be val1.val2.val3.

func getProjectOpts() []cfg.ConfigOption {
	return []cfg.ConfigOption{
		{FlagName: "myflag", Shorthand: "", Value: 100, ConfigKey: "val1.val2.val3",
			Usage: "Config key example."},
	}
}
// config: {Val1:{Val2:{Val3:100}}}

func getProjectOpts() []cfg.ConfigOption {
	return []cfg.ConfigOption{
		{FlagName: "myflag", Shorthand: "", Value: 100, ConfigKey: "val1.val2.val3000",
			Usage: "Config key example."},
	}
}
// config: {Val1:{Val2:{Val3:0}}}

A limitation here is that you can only unmarshal project options to exported struct fields. This has to do with settability in reflection: see the Structs section in the Laws of Reflection blog post.

Custom config keys

It is possible to use custom config keys for your struct, if desired. This can be achieved with the help of the mapstructure struct tag. Take a look at the following example:

type Config struct {
	Val1 MyType1 `mapstructure:"custom1"`
}
type MyType1 struct {
	Val2 MyType2 `mapstructure:"custom2"`
}
type MyType2 struct {
	Val3 int `mapstructure:"custom3"`
}

func getProjectOpts() []cfg.ConfigOption {
	return []cfg.ConfigOption{
		{FlagName: "myflag", Shorthand: "", Value: 100, ConfigKey: "custom1.custom2.custom3",
			Usage: "Config key example."},
	}
}
// config: {Val1:{Val2:{Val3:100}}}

This is particularly useful for multi-word struct keys, especially when associating them with environment variables:

type Config struct {
	Auth Auth
}
type Auth struct {
	JWTSecret string `mapstructure:"jwt_secret"`
}

func getProjectOpts() []cfg.ConfigOption {
	return []cfg.ConfigOption{
		{FlagName: "jwt-secret", Shorthand: "", Value: "dontlook", ConfigKey: "auth.jwt_secret",
			Usage: "Config key example."},
	}
}

// Note that the main function above was used.
// $ export DEMO_AUTH_JWT_SECRET='realsecret' && go run main.go 
// config: {Auth:{JWTSecret:realsecret}}

Personal notes

When working with configs, I often found myself repeating the same patterns for coding a basic configuration setup on my projects. For this reason, I abstracted away that pattern to a custom package that I find useful for most of my projects.

However, this works slightly different that how viper would have worked by default using a similar setup. I find that in some aspects what viper is doing is not intuitive, at least for me, and for this reason the usage of this package is slightly different than viper's usage. For example:

• Files set via viper.SetConfigFile throw a different error if not found than if set via viper.AddConfigPath combined with viper.SetConfigName and viper.SetConfigType;
• Writing files using viper.WriteXXX and viper.SafeWriteXXX is a challenge. Additionally, these same functions behave differently if the config file was set with one of the two methods above;
• The behaviour of the config files is just so different between the two approaches listed above it's just unbelieveable. I often get lost working with config files with viper;
• viper.SetConfigFile doesn't seem to actually overwrite what was set via viper.AddConfigPath as mentioned in the docs.

The comments I currently left to the viper repository can be found on my open source contribution list. I will likely make some more contributions in the future.