A benchmark analysis of the quality of distributed additive manufacturing centers

Elisa Verna (DIGEP, Politecnico di Torino, Turin, Italy)
Domenico Augusto Maisano (DIGEP, Politecnico di Torino, Turin, Italy)

International Journal of Quality & Reliability Management

ISSN: 0265-671X

Article publication date: 13 January 2022

Issue publication date: 19 May 2022

871

Abstract

Purpose

Nowadays, companies are increasingly adopting additive manufacturing (AM) technologies due to their flexibility and product customization, combined with non-dramatic increases in per unit cost. Moreover, many companies deploy a plurality of distributed AM centers to enhance flexibility and customer proximity. Although AM centers are characterized by similar equipment and working methods, their production mix and volumes may be variable. The purpose of this paper is to propose a novel methodology to (1) monitor the quality of the production of individual AM centers and (2) perform a benchmarking of different AM centers.

Design/methodology/approach

This paper analyzes the quality of the production output of AM centers in terms of compliance with specifications. Quality is assessed through a multivariate statistical analysis of measurement data concerning several geometric quality characteristics. A novel operational methodology is suggested to estimate the fraction nonconforming of each AM center at three different levels: (1) overall production, (2) individual product typologies in the production mix and (3) individual quality characteristics.

Findings

The proposed methodology allows performing a benchmark analysis on the quality performance of distributed AM centers during regular production, without requiring any ad hoc experimental test.

Originality/value

This research assesses the capability of distributed AM centers to meet crucial quality requirements. The results can guide production managers toward improving the quality of the production of AM centers, in order to meet customer expectations and enhance business performance.

Keywords

Citation

Verna, E. and Maisano, D.A. (2022), "A benchmark analysis of the quality of distributed additive manufacturing centers", International Journal of Quality & Reliability Management, Vol. 39 No. 6, pp. 1488-1505. https://doi.org/10.1108/IJQRM-07-2021-0214

Publisher

:

Emerald Publishing Limited

Copyright © 2021, Elisa Verna and Domenico Augusto Maisano

License

Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcode


1. Introduction

In today's highly competitive global market, a growing number of companies of all sizes adopt distributed manufacturing solutions, focusing on high product customization (Maisano et al., 2020; Matt et al., 2015; Srai et al., 2016). Some important advantages of distributed manufacturing are flexibility, proximity to customers, more accurate and timely information and greater adaptability to demand fluctuations (Rauch et al., 2017, 2018; Roca et al., 2019). Nevertheless, distributed manufacturing has some weaknesses compared to traditional centralized manufacturing, such as higher capital investment to create more production facilities, less exploitation of economies of scale, higher costs per unit and higher complexity in coordinating and managing distributed manufacturing processes. However, as technology continues to grow, the arguments in favor of distributed manufacturing tend to outweigh the arguments against it (Srai et al., 2016).

One of the outstanding emerging technologies of the last decades is additive manufacturing (AM), which has enabled high customization and complexity levels. AM technologies have led to the epochal shift from the so-called “mass production” to “job production,” also referred to as “mass customization” (Galetto et al., 2020; Pine, 1993; Verna et al., 2020). In this paper, the research focus will be on AM processes, from the practical perspective of companies having to manage and coordinate a plurality of similar, albeit not identical, distributed AM centers. Such centers may be characterized by similar technology equipment, but may differ in terms of (1) technology solutions, (2) work parameters and/or (3) materials (Gibson et al., 2010; Huang et al., 2017). In addition, the production quantities and/or production mixes of different AM centers may vary depending on their specific demand (Durão et al., 2017; Rauch et al., 2018; Zijm et al., 2019).

In this scenario, the need arises for companies to monitor, evaluate and compare the quality performance of their AM centers, so as to (1) take a general picture of the entire production, (2) identify possible local criticalities and (3) guide possible improvement actions. In particular, the quality of the production output of AM centers is intended as its compliance with the relevant specifications, which are imposed by customers (Montgomery, 2019).

Monitoring and evaluating the quality of production is worth threefold in practice, as it enables:

  1. to evaluate the performance of single AM centers,

  2. a benchmark analysis between different AM centers, highlighting their strengths and weaknesses and

  3. to drive improvement in each AM center by identifying the most profitable solutions implemented in “competing” centers.

The inherent diversity among AM centers – not only in terms of production equipment but also in terms of quantitative (i.e. total production quantity, geometric/functional characteristics of individual product units) and qualitative (i.e. production mix) characteristics of the related productions – makes performing structured and rigorous quality assessments not straightforward.

The purpose of this paper is to propose a methodology for a structured comparison of a plurality of AM centers from the perspective of their quality performance. Quality is assessed through a multivariate statistical analysis of the compliance of different typologies of products, based on multiple quality characteristics, leading to an estimate of the overall defectiveness (or fraction nonconforming) of individual AM centers. A key distinguishing feature of the proposed analysis is not to require any ad hoc experimental testing, being based entirely on the information collected during regular production.

The remainder of this paper is organized into five sections. Section 2 presents the novel methodology to assess the quality performance of each AM center; this methodology is based on a multivariate statistical approach for estimating the conformity of the products in each AM center. Section 3 presents a real-world case study of a company dedicated to designing and manufacturing automotive tool components, which are produced in several distributed AM centers. The case study will exemplify the methodology proposed in Section 2. Section 4 summarizes the findings of the present study, specifying practical implications, limitations and insights for future research.

2. Research method

Consistently with the general definition of quality, that is, the “degree to which a set of inherent characteristics of an object fulfils requirements” (ISO 9001:2015, 2015), the quality of a generic manufacturing process can be defined as the “ability to produce products that meet the relevant specifications.” In this paper, multiple AM centers are assumed to produce the same typologies of products, though in different quantities and mixes. A combination of three factors characterizes each AM center: (1) production equipment/machines and corresponding work/process parameters, (2) materials with specific characteristics and (3) operators and related work practices.

Such factors contribute to variability in production output, referred to as the “inability to produce identical units of output” (Montgomery, 2019). Variability is classified as natural if it refers to a production process that runs smoothly, without accidents/anomalies that can be systematically attributed to at least one of the three aforementioned factors (e.g. machine failure, imperfect materials or human error) (Swamidass, 2000; Woodall and Thomas, 1995). Anomalies/incidents are occurrences that may occasionally be present in a process, which result in an increased variability compared to the natural one, leading to an unacceptable level of process performance. When assignable causes of variations occur, these result in a shift to an out-of-control state where a larger proportion of the process output does not conform to requirements (Montgomery, 2019). With accidents/anomalies, variability tends to increase and, alongside it, the propensity to produce products that do not meet specifications (Montgomery, 2019). However, even in the absence of anomalies/accidents, a process can generate nonconforming products, since this may depend on how stringent the product specifications associated with quality characteristics are, compared to the corresponding natural variability.

The remainder of this section proposes a novel methodology to qualitatively assess the degree of suitability of different distributed AM processes, with respect to the production they are supposed to achieve. The existing scientific literature thoroughly addresses this issue within the so-called process capability analysis (de-Felipe and Benedito, 2017; González and Sánchez, 2009; ISO 22514-6:2013, 2013). Although the proposed methodology is inspired by some widespread approaches in this field, it is purposefully tailored with reference to the considered problem. In detail, the following four features define the problem of interest, which is characterized by the following four features:

  1. In each AM center, the production is divided into the so-called jobs, in which product units of various typologies are produced at the same time (e.g. part typologies α, β, γ). A job can be defined as “an elementary production run that generates amacro-product,” given by the composition of product units of various typologies, according to the customer demand” (Choudhari et al., 2012).

  2. Several characteristics and related specifications distinguish each typology of product, for example, geometric quality characteristics.

  3. Depending on current demand, jobs may vary in terms of (1) total quantity of product units and (2) corresponding assortment (i.e. subdivision of products into various typologies).

  4. For shortening production time and costs, production capacity of each AM center should be saturated as much as possible, job by job. Clearly, the number of products to be manufactured in a given job depends on the geometric characteristics of the production equipment (e.g. the geometric characteristics of the plate of the AM machines) and the part units.

In summary, the proposed methodology includes two main phases: (1) the production data gathering and (2) the multivariate statistical approach to analyze these data.

2.1 Production data gathering

Data collection can be performed during regular production, without requiring expensive and time-consuming ad hoc experimental testing. In order not to distort the analysis, it is essential that production takes place in the absence of incidents/anomalies of any kind. To this end, it is recommended that technicians, operators and engineers follow the production process closely during data collection. A job-to-job production sampling is then performed in each AM center, until an adequate quantity of production units is collected (indicatively, at least 15–20 units for each product typology) (Montgomery, 2019). This amount of data is reasonably acceptable for the statistical analysis described in Section 2.2. Clearly, increasing the number of units collected will increase the accuracy of the statistical analysis, but it will also increase the associated costs (Montgomery, 2019).

Next, parts of the same typology are aggregated for each AM center, independently of the jobs in which they were produced. This aggregation is reasonable under the assumption – that will be verified – that the “job factor” has no systematic effect.

The last step entails the measurement of the quality characteristics related to each typology of part. To this aim, it is convenient to use a relatively accurate measuring instrument that allows neglecting the measurement uncertainty, with respect to the variability of the measured quality characteristics (Montgomery, 2019). Alternatively, the measurement uncertainty has to be included in the analysis, thereby complicating it.

2.2 Multivariate statistical approach for quality performance benchmarking

The proposed analysis is based on a common assumption in multivariate process capability analysis, namely that quality characteristics related to the same typology of product can be modeled as correlated random variables, which are distributed according to a multivariate normal distribution (Alevizakos and Koukouvinos, 2020; Chen et al., 2003; Ross, 2009; Tano and Vännman, 2012; Wang, 2005). A normality test, such as the Anderson–Darling (AD) test, may be performed to verify the normality of the distribution of each individual quality characteristic, for each part typology and AM center (Montgomery, 2019).

Then, the relevant normal multivariate distribution parameters should be estimated using the sample of measurement data collected in the previous phase (see Section 2.1). In detail, for each product typology and AM center, the (1) vector of mean values and (2) covariance matrix of the corresponding quality characteristics can be estimated. Whereas the sample mean and covariance are unbiased estimators of the process mean and covariance, the sample variance is a biased estimator as it systematically underestimates the process variance (Ross, 2009). Such a bias may be corrected through the parameter c4 (see Cochran's theorem) (Bapat, 2000), which depends on the sample size (n) of the data used to determine the sample variance and can be found in the scientific literature (Duncan, 1974; Montgomery, 2019). Accordingly, the unbiased estimates of the multivariate normal distribution parameters are:

(1)μ^x=i=1nxin,σ^x=sxc4=1c4i=1n(xiμx)2n1,cov^(x,y)=i=1n(xiμx)(yiμy)n1,
where:
  1. n” is the size of the sample selected for estimating the process parameters,

  2. “ˆ” is the hat operator, denoting estimated values,

  3. μ^x” is the estimation of the mean value of the generic quality characteristic x, through the sample mean,

  4. sx” is the sample standard deviation that, after being corrected using the parameter c4, provides an unbiased estimate (σ^x) of the standard deviation of x and

  5. cov^(x,y)” is the unbiased estimation of the covariance between two generic quality characteristics x and y through the sample covariance.

The above parameters allow reconstructing the multivariate normal distributions related to the quality characteristics of each part typology, with reference to a certain AM center. The next step is to estimate the fraction of nonconforming products produced by the AM centers by comparing the multivariate normal distributions with the associated specifications. A preliminary estimate of the fraction nonconforming, from the perspective of a single quality characteristic, can be made by integrating the univariate normal distribution of the quality characteristic into the two “tails” beyond the relevant specification limits: lower specification limit (LSL) and upper specification limit (USL). For quality characteristics with unilateral specifications, only one tail (right or left, depending on the specific case) has to be considered.

The next step of the proposed methodology concerns the estimation of the overall fraction of nonconforming products – pi, that is, the fraction of parts of i-th typology, which do not meet at least one of the related quality characteristics – by integrating the normal multivariate distribution externally with respect to the hyper-rectangular region, delimited by the specification limits of the respective quality characteristics (de-Felipe and Benedito, 2017). As exemplified in Section 3 referring to the case study, a Monte Carlo numerical integration can be performed for each part typology and each machine, generating a number of multivariate random realizations of some variables, which are compatible with the respective mean-value vectors and covariance matrix.

For a specific AM center, a synthetic indicator of the overall fraction nonconforming (p) of the total production output (i.e. considering the totality of part typologies) can be defined as:

(2)p=i{α,β,}pi(wimi)i{α,β,}(wimi),
where:
  1. mi is the mass of material, including material for support bases and purging, related to the production of the i-th part typology,

  2. wi is an indicator of the portion of parts of i-th typology, for a given production mix and

  3. α, β, … are the product typologies.

Eq. (2) is a weighted sum of the pi values with respect to the corresponding mass (mi), for each i-th part typology. This form of weighing seems reasonable, considering that the different parts are produced according to different product mixes. Additionally, p can be seen as the ratio between the mass related to the fraction nonconforming of products and the total mass of products from a certain AM center. Such a synthetic indicator can represent a performance measure of the quality of each AM center. Indeed, the higher the value of p, the lower the ability of the AM center to meet the quality requirements imposed by the customers. The analysis of this indicator for a certain AM center and its comparison with the indicators related to other “competing” centers can support managers in selecting quality improvements actions.

Section 3 exemplifies the application of the proposed methodology to a real case study in the automotive sector, highlighting its practical utility.

3. Case study

3.1 AM centers and production data

In the proposed case study, three AM centers of a company specialized in designing and implementing tooling solutions for the automotive industry are considered. The company's name is not revealed for confidentiality reasons. The product units manufactured include inspection fixtures, production and assembly jigs that can be used as support tools, both in the design/prototyping and in the production/assembly phases. Figure 1 shows some sample fixtures of different geometry that allow the precise positioning of some pressed sheet-metal components of a car door during assembly or dimensional quality inspections.

Three specific typologies of fixtures (referred to as α, β and γ) with comparable overall dimensions are considered. These fixtures can be used to support the proper placement of specific automotive components during various in-line tests and are only a few centimeters in size. The precise geometry of the three fixtures is not disclosed for reasons of confidentiality. For each geometry, three quality characteristics that are crucial for the functionality of the fixture itself are identified (i.e. α.1, α.2, α.3, β.1, β.2, etc.); each of these quality characteristics is associated with corresponding specifications. Table 1 reports the nominal value (NV) and the LSL and USL for each quality characteristic. As shown, specifications are generally not very stringent since they are of the order of magnitude of a few tenths of a millimeter.

Further technical requirements characterizing the production of the fixtures of interest are summarized below:

  1. the parts are generally not produced in large quantities, albeit with a variable production mix, depending on current demand,

  2. the parts do not have particular structural properties, as they are mainly used as a support for the positioning of specific automotive components during assembly operations and

  3. being in contact with metal automotive components, parts are made of a softer material that can be worn without scratching metal components.

Fixtures are produced in three distributed AM centers, referred to as “Center I,” “Center II” and “Center III.” All AM centers use polymeric materials, although the three different machines in use are not disclosed for industrial secrecy reasons. Although these AM centers adopt the same technology, that is fused deposition modeling (FDM), the architecture and equipment of the AM machines are different, leading to possible differences in terms of resulting quality of the parts (Galetto et al., 2021). The AM machines used in each AM center have different production capacity: the machine of Center I has the largest surface of the plate, followed by that of Center II and Center III, respectively. To ensure a certain standardization of the manufactured products, all the machines are equipped with filaments of proprietary materials (both in reference to the parts and to the corresponding support bases), whose mechanical/functional properties and parameters of the deposition process are available in the technical sheets provided by the material supplier.

The effective production of each AM center was monitored and sampled for a variable period in order to collect an adequate amount of product units, that is, about 15–20 for each part typology (α, β and γ). To assure that the sampled data reflect the behavior of the production processes – in the absence of accidents/anomalies or any systematic source that could bias the natural variability (Montgomery, 2019) – the AM processes were supervised by skilled and experienced technicians. The production of each AM center is organized into jobs, characterized by a certain mix of the parts α, β and γ. Secondly, the number of units produced in each job may vary from machine to machine, being related to the plate surface. For example, the machine of Center I can produce a dozen units per job, that is, about twice as many as the machine of Center III; the machine of Center II has an intermediate capacity. Table 2 describes the job-to-job configurations related to the production carried out on the three AM centers.

A DEA Global Image coordinate measuring machine (CMM) with a maximum permissible error (MPE) of about 3 µm was used to measure the quality characteristics. The resolution of this instrument is about two orders of magnitude lower than the intrinsic variability of the measurands, which is of the order of magnitude of one-tenth of a millimeter; see Table A1 (Hexagon Manufacturing Intelligence, 2021). For each part type, a measurement cycle was constructed and automatically performed. In order to obtain a more accurate estimate and avoid possible measurement errors, three replicated measurements were carried out for each quality characteristic and then aggregated through the arithmetic mean. Measurement results related to the parts manufactured in each of the three AM centers are reported in Tables A1–A3, respectively.

The box-plot in Figure 2 shows that the “job factor” does not seem to determine systematic differences in the quality characteristic α.1, with reference to the parts produced in AM Center I; the four boxes relating to the four jobs are, in fact, all overlapping (Ross, 2009). To provide statistical evidence of the nonsignificance of the “job factor,” a one-way ANOVA (Ross, 2009) is also performed, confirming that there is no systematic difference between the means of the jobs with respect to the quality characteristic α.1, with a p-value of 0.178. The same result can be extended to all quality characteristics of all typologies of parts produced in any AM center, allowing, therefore, to aggregate data related to the same part typology, which are produced in different jobs in the same AM center.

Next, the AD test was used to test the normality of the distribution of each individual quality characteristic for each product typology and AM center (Marsaglia and Marsaglia, 2004). The relatively high p-values of the AD test show that the assumption of normality is not contradicted for any quality characteristics (see Table A4).

Eq. (1) is then applied to estimate the mean values and covariance matrices related to the quality characteristics of each product typology and AM center. Such values are contained in Table 3. It is interesting to note that the quality characteristics related to the same product type are often correlated. For instance, referring to AM Center I, the quality characteristics α.2 and α.3 are positively correlated, that is, cov(α.2, α.3) = 0.0014, corresponding to a Pearson correlation coefficient ρα.2, α.3 = 77.4%, while the quality characteristics γ.1 and γ.3 are negatively correlated, that is, cov(γ.1, γ.3) = −0.0008, corresponding to a Pearson correlation coefficient ργ.1, γ.3 = −52.8% (Ross, 2009).

Next, a Monte Carlo numerical integration was carried out for each part typology and AM center, after generating 10,000 multivariate random realizations of some variables, compatible with the respective mean-value vectors and covariance matrix. For this purpose, the “Calc > Random Data > Multivariate Normal Distribution” function of Minitab was adopted (Minitab, 2021).

3.2 Results and discussion

Results of the integration are shown in Table 4 and Figure 3. The fraction nonconforming related to a single quality characteristic of certain part typology is derived by integrating the univariate normal distribution of the quality characteristic into the two “tails” beyond the relevant specification limits, for example, for the quality characteristic α.1, related to the typology-α parts manufactured in AM Center I, the fraction nonconforming can be determined as pα.1 = P(xα.1 < LSLα.1) + P(xα.1 > USLα.1) = 0.17%.

In addition, Table 4 shows that, for a given AM center and part typology, the overall fraction nonconforming is lower than the sum of the fractions nonconforming related to corresponding quality characteristics (e.g. pα < pα.1 + pα.2 + pα.3). This finding is not surprising as the individual quality characteristics are not statistically independent (see covariance matrices on Table 3).

Focusing on the fraction nonconforming related to the single parts (i.e. pα, pβ, pγ, as shown in Table 4), AM Center I has the lowest fraction nonconforming, while AM Center III has the highest one. This result is even more evident when considering the synthetic indicator associated with the entire production of a certain AM center (see Eq. (2). A uniform production mix for each AM center was here considered: that is, wi = ⅓ ∀i∈{α, β, γ}; the mi values are estimated in the last column of Table 5. The resulting p values are shown in Figure 3, supporting the assumption that AM Center I has the lowest p-value, while AM Center III has the highest one.

The proposed fraction nonconforming indicators – at the level of (1) individual quality characteristics (e.g. pα.1, pα.2, etc.), (2) single parts (i.e. pα, pβ, pγ) and (3) overall production output of each AM center – (p) provide a snapshot of the current quality of each AM center, facilitating comparison with other AM centers.

The results in Table 4 and Figure 3 show that Center III is the worst in terms of part quality for all three part typologies (α, β and γ). In particular, the gap between Center III and the first two centers is particularly evident for part α, the defectiveness being about 5 percentage points higher (i.e. 7.15% vs. 2.23% and 2.01%, respectively). Centers I and II perform similarly for parts α and β, while showing some difference for the part γ, as the fraction nonconforming of Center II is more than 1.5 times higher than that of Center I.

The AM center with lowest fraction nonconforming of overall production is Center I (3.62%), followed by Center II (6.02%) and then Center III (9.22%). Center I's supremacy is probably due to the use of a new-generation FDM system, with increased production capacity and quality of production output. In the light of these results, it would be appropriate for production managers to ensure that Centers II and III reach the quality levels of Center I, taking the latter as a benchmark.

4. Conclusions

This paper proposed an operational methodology to compare distributed AM centers, characterized by job-by-job productions with similarities in terms of parts produced, quantities produced and production mix. The comparison is conducted by analyzing the AM centers from the point of view of the quality of production, intended as capability to meet the product specifications imposed by costumers. In detail, the proposed methodology makes it possible to estimate the fraction nonconforming of each AM center, at the level of (1) individual quality characteristics, (2) individual product typologies and (3) overall production. Providing a synthetic picture of the quality performance of the AM centers being compared, it can also be useful to guide potential improvement actions (Maisano et al., 2020). The operational methodology was then exemplified in a real-world case study of an industrial company producing automotive tool components in three distributed AM centers.

A distinctive feature of the proposed analysis is that it does not require any ad hoc experimental testing. Only a preliminary sampling of (part of) the actual production of each AM center is required. Afterward, relevant quality characteristics of the sampled parts have to be measured. In the case study, dimensional quality characteristics were measured using a CMM; however, the proposed methodology can be adapted to other types of quality characteristics (e.g. microhardness, surface roughness, residual stresses).

The proposed methodology is quite general as it can be applied to benchmark a plurality of AM centers, with different production volumes and mixes. The application to the specific case study exemplified a possible quality assessment and ranking of three “competing” AM centers. Since these results refer to the specific typologies of products analyzed, with their respective specifications and production mix, they do not necessarily have general validity. By changing the typology of parts and therefore their structural, geometric and constructional characteristics, the quality performance of AM centers can change.

This research has several practical implications. By applying the proposed methodology, companies with several distributed AM centers can make more structured evaluations and comparisons in terms of quality performance. The proposed methodology may also guide management in assigning rewards to leading centers and stimulate performance improvement in others. In addition, it can help implement ambitious plans such as zero waste, zero-defect manufacturing or the achievement of sustainable development goals (Psarommatis et al., 2020; Verna et al., 2021).

Some limitations to the proposed methodology are summarized below:

  1. The production mix of each AM center is assumed to include products with similar geometry (i.e. volume, height, etc.) and constructional characteristics (i.e. typology of material, infill strategy/density and deposition path).

  2. The quality characteristics of each part typology are assumed to follow a multivariate normal distribution. Although this assumption is relatively common in the scientific literature concerning process capability analysis, it has to be verified case-by-case.

  3. The measurement uncertainty of the instruments used to measure the quality characteristics was neglected.

  4. For the comparison between AM centers not to be far-fetched, it seems reasonable to assume that the centers themselves adopt the same production and quality control practices. This scenario is quite realistic, as companies often centralize quality assurance and planning activities, defining operational practices to be adopted uniformly in distributed manufacturing centers (Illés et al., 2017).

  5. The comparison of distributed AM centers does not consider costs (e.g. cost of energy, material and labor).

Future research should take into account and overcome (at least some of) the limitations mentioned above. Additionally, the proposed quality analysis will also be extended to distributed AM productions of metal parts and will be complemented with a sustainability analysis.

Figures

Sample fixtures used as supports for parts manufactured in bent-sheet metal during assembly and/or dimensional inspection in the automotive industry

Figure 1

Sample fixtures used as supports for parts manufactured in bent-sheet metal during assembly and/or dimensional inspection in the automotive industry

Box-plot of the quality characteristic α.1, relating to the α part typologies, produced by AM Center I

Figure 2

Box-plot of the quality characteristic α.1, relating to the α part typologies, produced by AM Center I

Estimation of the fraction nonconforming of the production output obtained through the three AM centers. Estimates are performed at the level of (1) individual quality characteristics (e.g. pα.1, pα.2, etc.), (2) single parts (i.e. pα, pβ, pγ) and (3) overall production output of each AM center (p)

Figure 3

Estimation of the fraction nonconforming of the production output obtained through the three AM centers. Estimates are performed at the level of (1) individual quality characteristics (e.g. pα.1, pα.2, etc.), (2) single parts (i.e. pα, pβ, pγ) and (3) overall production output of each AM center (p)

Geometric quality characteristics of the parts α, β and γ

LabelTypeDescriptionNVLSLUSL
Part αα.1DimensionalTwo-plane distance [mm]34.5034.3534.65
α.2DimensionalInternal diameter [mm]18.4018.3018.50
α.3FormCylindricity [mm]0.20
Part ββ.1DimensionalHole spacing [mm]48.6048.4548.75
β.2DimensionalTwo-plane distance [mm]24.3024.1524.45
β.3FormFlatness [mm]0.20
Part γγ.1DimensionalTwo-plane distance [mm]15.0014.8015.20
γ.2DimensionalTwo-plane distance [mm]28.6028.4528.75
γ.3OrientationParallelism [mm]0.15

Job-to-job sampled production of each AM center. For each job, the mix of parts produced, the relevant typology and number are given

Job(a) AM Center I(b) AM Center II(c) AM Center III
αβγJob totalαβγJob totalαβγJob total
183112243966
239128866
32101233392316
475124591326
5353114593216
635192316
7189426
8 516
9 1416
10 1236
Column total211919592121206219202160

Mean values and covariance matrix related to the data reported in Tables A1–A3

α.1α.2α.3 β.1β.2β.3 γ.1γ.2γ.3
(a) AM Center I
Mean values 34.49118.3900.093 48.61524.2670.068 14.98028.6270.095
Covariance matrixα.10.0010−0.00010.0000β.10.00140.00000.0002γ.10.0012−0.0002−0.0008
α.2−0.00010.00250.0014β.20.00000.00290.0013γ.2−0.00020.00100.0007
α.30.00000.00140.0013β.30.00020.00130.0013γ.3−0.00080.00070.0016
(b) AM Center II
Mean values 34.47218.3760.064 48.61224.2570.071 15.01028.5680.104
Covariance matrixα.10.00110.00030.0002β.10.00160.0001−0.0004γ.10.0018−0.0006−0.0003
α.20.00030.00170.0010β.20.00010.00110.0003γ.2−0.00060.00210.0011
α.30.00020.00100.0010β.3−0.00040.00030.0017γ.3−0.00030.00110.0023
(c) AM Center III
Mean values 34.48318.4330.082 48.56324.3330.073 14.99828.5700.100
Covariance matrixα.10.00130.00050.0006β.10.00230.00120.0010γ.10.0021−0.0006−0.0009
α.20.00050.00230.0021β.20.00120.00350.0024γ.2−0.00060.00270.0013
α.30.00060.00210.0026β.30.00100.00240.0025γ.3−0.00090.00130.0018

Estimation of the fraction nonconforming related to (1) individual quality characteristics (e.g. pα.1, pα.2, etc.), (2) single parts (i.e. pα, pβ, pγ) and (3) overall production output of each AM center (p)

(a) AM Center I(b) AM Center II(c) AM Center III
pα.10.17%1.80%5.35%
pα.20.20%0.10%1.18%
pα.31.90%0.12%1.27%
pα2.23%2.01%7.15%
pβ.10.01%0.05%1.24%
pβ.21.49%0.11%0.98%
pβ.31.31%3.14%2.79%
pβ2.78%3.30%4.54%
pγ.11.17%1.98%4.41%
pγ.20.01%0.49%0.95%
pγ.35.62%11.90%12.27%
pγ6.31%14.15%17.04%
p3.62%6.02%9.22%

Approximate volume and mass of each typology of product unit (α, β and γ) and relevant support base

Part typologyApproximate unitary volume and mass
Product unitSupport baseTotal
α67.7 cm348.6 g2.6 cm31.8 g70.3 cm3mA = 50.4 g
β59.3 cm342.5 g2.2 cm31.6 g61.5 cm3mB = 44.1 g
γ52.4 cm337.5 g2.9 cm32.1 g55.3 cm3mC = 39.6 g

Dimensional measurements related to the quality characteristics of the parts produced in AM Center I. The values highlighted in gray do not meet the corresponding specification limits (cf. Table 1)

Dimensional measurements related to the quality characteristics of the parts produced in AM Center II. The values highlighted in gray do not meet the corresponding specification limits (cf. Table 1)

Dimensional measurements related to the quality characteristics of the parts produced in AM Center III. The values highlighted in gray do not meet the corresponding specification limits (cf. Table 1)

Results of applying the Anderson–Darling normality test to the data reported in Tables A1–A3, regarding the quality characteristics of the parts produced by each AM center

(a) AM Center I(b) AM Center II(c) AM Center III
MeanSt.Dev.NADp-valueMeanSt.Dev.NADp-valueMeanSt.Dev.NADp-value
α.134.490.031210.1880.89134.470.033210.4430.25934.480.036190.2280.783
α.218.390.049210.2400.74518.380.041210.4360.27018.430.047190.3970.335
α.30.0930.036210.2950.5630.0640.032210.1800.9030.0820.050190.2590.676
β.148.610.036190.2030.85648.610.042210.7360.04648.560.046200.6070.099
β.224.270.053190.4620.23024.260.057210.1780.90824.330.059200.4100.312
β.30.0680.035190.5470.1380.0710.036210.2510.7070.0730.049200.3900.349
γ.114.980.004190.3010.54515.010.041200.4040.32315.000.044210.2230.801
γ.228.630.032190.1870.89128.570.045200.5640.12528.570.051210.2630.665
γ.30.095050.040190.2980.5510.1040.047200.2010.8630.1000.042210.4400.264
Appendix

This section contains further tables related to the quality benchmarking, concerning the real-world case study in Section 3

References

Alevizakos, V. and Koukouvinos, C. (2020), “Evaluation of process capability in gamma regression profiles”, Communications in Statistics-Simulation and Computation, pp. 1-16, doi: 10.1080/03610918.2020.1758941 (In press).

Bapat, R.B. (2000), Linear Algebra and Linear Models, 2nd ed., Springer, New York.

Chen, K.S., Pearn, W.L. and Lin, P.C. (2003), “Capability measures for processes with multiple characteristics”, Quality and Reliability Engineering International, Vol. 19 No. 2, pp. 101-110.

Choudhari, S.C., Adil, G.K. and Ananthakumar, U. (2012), “Exploratory case studies on manufacturing decision areas in the job production system”, International Journal of Operations and Production Management, Vol. 32 No. 11, pp. 1337-1361.

de-Felipe, D. and Benedito, E. (2017), “A review of univariate and multivariate process capability indices”, The International Journal of Advanced Manufacturing Technology, Vol. 92 No. 5, pp. 1687-1705.

Duncan, A.J. (1974), Quality Control and Industrial Statistics, 4th ed., R.D. Irwin, Homewood.

Durão, L.F.C.S., Christ, A., Zancul, E., Anderl, R. and Schützer, K. (2017), “Additive manufacturing scenarios for distributed production of spare parts”, The International Journal of Advanced Manufacturing Technology, Vol. 93, pp. 869-880.

Galetto, M., Genta, G., Maculotti, G. and Verna, E. (2020), “Defect Probability estimation for hardness-optimised parts by selective laser melting”, International Journal of Precision Engineering and Manufacturing, Vol. 21 No. 9, pp. 1739-1753.

Galetto, M., Verna, E. and Genta, G. (2021), “Effect of process parameters on parts quality and process efficiency of Fused Deposition Modeling”, Computers and Industrial Engineering, Vol. 156, p. 107238.

Gibson, I., Rosen, D.W. and Stucker, B. (2010), Additive Manufacturing Technologies, Springer, New York.

González, I. and Sánchez, I. (2009), “Capability indices and nonconforming proportion in univariate and multivariate processes”, The International Journal of Advanced Manufacturing Technology, Vol. 44 Nos 9-10, pp. 1036-1050.

Hexagon Manufacturing Intelligence (2021), GLOBAL Classic, available at: https://www.hexagonmi.com/en-GB/products/coordinate-measuring-machines/bridge-cmms/global-classic.

Huang, R., Riddle, M.E., Graziano, D., Das, S., Nimbalkar, S., Cresko, J. and Masanet, E. (2017), “Environmental and economic implications of distributed additive manufacturing: the case of injection mold tooling”, Journal of Industrial Ecology, Vol. 21 No. S1, pp. S130-S143.

Illés, B., Tamás, P., Dobos, P. and Skapinyecz, R. (2017), “New challenges for quality assurance of manufacturing processes in industry 4.0”, Solid State Phenomena, Trans Tech Publications, Vol. 261, pp. 481-486.

ISO 22514-6:2013 (2013), Statistical Methods in Process Management – Capability and Performance – Part 6: Process Capability Statistics for Characteristics Following a Multivariate Normal Distribution, International Organization for Standardization (ISO), Geneva.

Quality Management Systems – Fundamentals and Vocabulary, International Organization for Standardization (ISO), Geneva.

Maisano, D.A., Franceschini, F. and Antonelli, D. (2020), “dP-FMEA: an innovative Failure Mode and Effects Analysis for distributed manufacturing processes”, Quality Engineering, Vol. 32 No. 3, pp. 267-285.

Marsaglia, G. and Marsaglia, J. (2004), “Evaluating the anderson-darling distribution”, Journal of Statistical Software, Vol. 9 No. 2, pp. 1-5.

Matt, D.T., Rauch, E. and Dallasega, P. (2015), “Trends towards distributed manufacturing systems and modern forms for their design”, Procedia Cirp, Vol. 33, pp. 185-190.

Minitab (2021), Select the Distribution and Enter the Parameters, available at: https://support.minitab.com/.

Montgomery, D.C. (2019), Introduction to Statistical Quality Control, 8th ed., Wiley Global Education, New York, NY.

Pine, B.J. (1993), Mass Customization, Harvard Business School Press, Boston, MA, Vol. 17.

Psarommatis, F., May, G., Dreyfus, P.-A. and Kiritsis, D. (2020), “Zero defect manufacturing: state-of-the-art review, shortcomings and future directions in research”, International Journal of Production Research, Vol. 58 No. 1, pp. 1-17.

Rauch, E., Dallasega, P. and Matt, D.T. (2017), “Distributed manufacturing network models of smart and agile mini-factories”, International Journal of Agile Systems and Management, Vol. 10 Nos 3-4, pp. 185-205.

Rauch, E., Unterhofer, M. and Dallasega, P. (2018), “Industry sector analysis for the application of additive manufacturing in smart and distributed manufacturing systems”, Manufacturing Letters, Vol. 15, pp. 126-131.

Roca, J.B., Vaishnav, P., Laureijs, R.E., Mendonça, J. and Fuchs, E.R.H. (2019), “Technology cost drivers for a potential transition to decentralized manufacturing”, Additive Manufacturing, Vol. 28, pp. 136-151.

Ross, S.M. (2009), Introduction to Probability and Statistics for Engineers and Scientists, Elsevier Academic Press, Burlington, MA.

Srai, J.S., Kumar, M., Graham, G., Phillips, W., Tooze, J., Ford, S., Beecher, P., Raj, B., Gregory, M., Tiwari, M., Ravi, B., Neely, A., Shankar, R., Charenley, F. and Tiwari, A. (2016), “Distributed manufacturing: scope, challenges and opportunities”, International Journal of Production Research, Vol. 54 No. 23, pp. 6917-6935.

Swamidass, P.M. (2000), Encyclopedia of Production and Manufacturing Management, Springer, Boston, MA, doi: 10.1007/1-4020-0612-8_620.

Tano, I. and Vännman, K. (2012), “Comparing confidence intervals for multivariate process capability indices”, Quality and Reliability Engineering International, Vol. 28 No. 4, pp. 481-495.

Verna, E., Genta, G., Galetto, M. and Franceschini, F. (2020), “Planning offline inspection strategies in low-volume manufacturing processes”, Quality Engineering, Vol. 32 No. 4, pp. 705-720.

Verna, E., Genta, G., Galetto, M. and Franceschini, F. (2021), “Towards Zero Defect Manufacturing: probabilistic model for quality control effectiveness”, 2021 IEEE International Workshop on Metrology for Industry 4.0 and IoT (MetroInd4.0 and IoT), Rome, Italy, 7-9 June 2021, IEEE, pp. 522-526, doi: 10.1109/MetroInd4.0IoT51437.2021.948.

Wang, C.-H. (2005), “Constructing multivariate process capability indices for short-run production”, The International Journal of Advanced Manufacturing Technology, Vol. 26 Nos 11-12, pp. 1306-1311.

Woodall, W.H. and Thomas, E.V. (1995), “Statistical process control with several components of common cause variability”, IIE Transactions, Vol. 27 No. 6, pp. 757-764.

Zijm, H., Knofius, N. and van der Heijden, M. (2019), “Additive manufacturing and its impact on the supply chain”, in Zijm, H., Klumpp, M., Regattieri, A. and Heragu, S. (Eds), Operations, Logistics and Supply Chain Management, pp. 521-543.

Acknowledgements

This research was partially supported by the award “TESUN-83486178370409 finanziamento dipartimenti di eccellenza CAP. 1694 TIT. 232 ART. 6,” which was conferred by “Ministero dell'Istruzione, dell'Università e della Ricerca.”

Corresponding author

Elisa Verna can be contacted at: elisa.verna@polito.it

Related articles