Mean Squared Error Algorithm

Details

Given $LaTex Math image.$ , a set of feature vectors $LaTex Math image.$ , and a set of respective responses $LaTex Math image.$ , the mean squared error (MSE) objective function $LaTex Math image.$ is a function that has the format:

$LaTex Math image.$

In oneDAL implementation of the MSE, the $LaTex Math image.$ is represented as:

$LaTex Math image.$

For a given set of the indices $LaTex Math image.$ , $LaTex Math image.$ , $LaTex Math image.$ , $LaTex Math image.$ , the value and the gradient of the sum of functions in the argument $LaTex Math image.$ respectively have the format:

$LaTex Math image.$

where

$LaTex Math image.$

Computation

Algorithm Input

The mean squared error algorithm accepts the input described below. Pass the

Input ID

as a parameter to the methods that provide input for your algorithm. For more details, see Algorithms.

Algorithm Input for MSE Computaion
Input ID	Input
argument	A numeric table of size $LaTex Math image.$ with the input argument $LaTex Math image.$ of the objective function.
data	A numeric table of size $LaTex Math image.$ with the data $LaTex Math image.$ .
dependentVariables	A numeric table of size $LaTex Math image.$ with dependent variables $LaTex Math image.$ .

Optional Algorithm Input

The mean squared error algorithm accepts the optional input described below. Pass the Optional

Input ID

as a parameter to the methods that provide input for your algorithm. For more details, see Algorithms.

Optional Algorithm Input for MSE Computaion
Input ID	Input
weights	Optional input. Pointer to the $LaTex Math image.$ numeric table with weights of samples. The input can be an object of any class derived from NumericTable except for PackedTriangularMatrix and PackedSymmetricMatrix . By default, all weights are equal to $LaTex Math image.$ .
gramMatrix	Optional input. Pointer to the :mathL`p times p` numeric table with pre-computed Gram matrix. The input can be an object of any class derived from NumericTable except for PackedTriangularMatrix and PackedSymmetricMatrix . By default, the table is set to empty numeric table.

Algorithm Parameters

The mean squared error algorithm has the following parameters. Some of them are required only for specific values of the computation method parameter method:

Algorithm Parameters for MSE Computaion
Parameter	Default value	Description
penaltyL1	$LaTex Math image.$	The numeric table of size $LaTex Math image.$ with L1 regularized coefficients.
penaltyL2	$LaTex Math image.$	The numeric table of size $LaTex Math image.$ with L2 regularized coefficients.
interceptFlag	true	Flag to indicate whether or not to compute the intercept.
algorithmFPType	float	The floating-point type that the algorithm uses for intermediate computations. Can be float or double .
method	defaultDense	Performance-oriented computation method.
numberOfTerms	Not applicable	The number of terms in the objective function.
batchIndices	Not applicable	The numeric table of size $LaTex Math image.$ , where $LaTex Math image.$ is the batch size, with a batch of indices to be used to compute the function results. If no indices are provided, the implementation uses all the terms in the computation. This parameter can be an object of any class derived from NumericTable except for PackedTriangularMatrix and PackedSymmetricMatrix .
resultsToCompute	gradient	The 64-bit integer flag that specifies which characteristics of the objective function to compute. Provide one of the following values to request a single characteristic or use bitwise OR to request a combination of the characteristics: value Value of the objective function nonSmoothTermValue Value of non-smooth term of the objective function gradient Gradient of the smooth term of the objective function hessian Hessian of smooth term of the objective function proximalProjection Projection of proximal operator for non-smooth term of the objective function lipschitzConstant Lipschitz constant of the smooth term of the objective function