mlx4 and mlx5 require Infiniband for special use cases (like usage with DPDK), we need to add some config for this:

CONFIG_INFINIBAND=m
CONFIG_INFINIBAND_USER_ACCESS=m
CONFIG_MLX4_INFINIBAND=m
CONFIG_MLX5_INFINIBAND=m