Q4(c) · UPSC Civil Services Mains 2022 · Sociology GS 1 · 15 marks · 2 min read

← Q4 Q5 →

What is reliability ? Explain the different tests available to social science researcher to establish reliability.

Topic: Works and Economic Life. Syllabus: Works and Economic Life: Social organization of work in different types of society; Formal and informal organization of work; Labour and society. Same official PYQ from year-wise 2022 and Works and Economic Life.

Revision summary

Reliability is consistency, not truth. Test-retest, parallel forms, split-half, Cronbach’s alpha, and inter-rater agreement are the main tests. Durkheim’s suicide files already needed stable coding. Census definition changes can mimic social change. A reliable scale can still miss Weber’s intended meaning.

Model answer

Introduction

Reliability is the consistency of a measure. If the same instrument, applied to the same kind of object under the same conditions, jumps about, the scores are unreliable. Validity is a later question: a clock can tick reliably and still tell the wrong time.

Body

What reliability is

  • In survey and test work, reliability is the share of variance that is not random error.
  • Emile Durkheim already needed stable classification of deaths before suicide rates could be compared. Unstable coding is an reliability failure in official data.
  • Qualitative work uses a cousin idea: inter-coder agreement and stable use of a codebook, not a claim that meanings never shift.

Test-retest

  • The same test is given twice to the same persons after an interval.
  • Use when the trait should be stable, such as a literacy item, not a mood item after a riot.
  • Memory and real change both threaten the correlation.

Parallel or alternate forms

  • Two versions of the scale are built to the same blueprint and both are given.
  • Use in examinations and long batteries to reduce item memory.
  • Costly to write well.

Split-half and internal consistency

  • The test is split, scores are correlated, and Spearman-Brown may correct the half-length.
  • Cronbach’s alpha estimates consistency among items of a Likert battery.
  • Use for attitude scales on, say, gender-role items in a student sample. Alpha is not a test of unidimensional truth, only of hanging together.

Inter-rater or inter-coder reliability

  • Two observers code the same focus-group transcript or Census occupation string.
  • Cohen’s kappa or percent agreement is reported.
  • Essential for content analysis, courtroom files, and open-ended NFHS-type comments.

Conditions and cautions

  • High reliability does not prove that “caste” or “work” was well conceptualised. That is validity, and Weber’s meaning problem.
  • Official series such as the Census need stable definitions across decades; a definition change looks like social change if reliability of the series is ignored.
  • Hidden populations reached by snowballing cannot borrow NFHS reliability claims without a design argument.

Flow diagram

flowchart TD
  REL[Reliability consistency] --> TT[Test-retest]
  REL --> PF[Parallel forms]
  REL --> SH[Split-half alpha]
  REL --> IR[Inter-rater]
  REL --> VAL[Validity is separate]

Conclusion

Reliability is consistency of a measure across time, forms, items, or raters. Test-retest, parallel forms, split-half, alpha, and inter-rater tests are the standard kit. Use them, then still ask whether the consistent score measures the sociological object.

Quick related

Students also ask

PYQ trend

When UPSC asked this

Related PYQs from other years, newest first. Open a question to read it.

  1. 2025 · Q1(c) · Sociology GS 1 · 10 marks

    What is a variable in social research? What are their different types? Elaborate.

    View answer →

  2. 2024 · Q5(c) · Sociology GS 1 · 10 marks

    Describe the differing principles of work organization in feudal and capitalist societies.

    View answer →

  3. 2021 · Q4(b) · Sociology GS 1 · 20 marks

    How has the idea of Work From Home forced us to redefine the formal and informal organisation of work ?

    View answer →

  4. 2020 · Q6(a) · Sociology GS 1 · 20 marks

    Discuss the new labour codes and their impact on formal and informal labour in India.

    View answer →

  5. 2019 · Q7(a) · Sociology GS 1 · 20 marks

    What is 'informal labour' ? Discuss the need for and challenges in regulating informal labour in the post-industrial society

    View answer →

  6. 2018 · Q6(a) · Sociology GS 1 · 20 marks

    Discuss the nature of social organization of work in capitalist society with reference to the Limits of the working day.

    View answer →

  7. 2017 · Q6(a) · Sociology GS 1 · 20 marks

    Trace the changing nature of organisation of work in capitalist society over the years

    View answer →

  8. 2016 · Q5(a) · Sociology GS 1 · 10 marks

    Describe the nature of social organization of work in industrial society.

    View answer →

More from this paper

Q1(a) · UPSC Mains 2022 · Sociology GS 1 · 10 marks

Delimit the scope of sociology in relation to other social sciences.

Sociology

Sociology studies patterned relations among groups and institutions as a whole. Comte, Durkheim, Weber, and Marx named that object in different ways. Economics, political science, psychology, history, and anthropology cut the same life along one axis. Census and NFHS already show large-scale social structure. The limit is complementary science, not a takeover of every neighbouring field.

Q1(b) · UPSC Mains 2022 · Sociology GS 1 · 10 marks

How does a researcher achieve objectivity in interpretative research?

Sociology as Science

Interpretative research studies meaning, not only counts. Weber kept value-relevance in problem choice and demanded value-discipline in proof. Harding’s strong objectivity names the researcher’s location. Geertz, prolonged fieldwork, triangulation, and respondent checks test the reading. Empathy without evidence is not objectivity.

Q1(c) · UPSC Mains 2022 · Sociology GS 1 · 10 marks

The difference between information and data in social science is subtle. Comment.

Social Change in Modern Society

Information is a report; data are information organised for a research question. Durkheim turned official suicide counts into sociological data by classification. Blumer warned that grids can freeze living meanings. Census and NFHS are public information until a defined indicator is built. Numbers alone do not make data.

Toppers' copies

Toppers' copies for this question will be uploaded soon.