I have compiled my experiences on systematic and automatic debugging in a university course. This is where you can learn more about the scientific method and delta debugging—but also about many more debugging and analysis techniques, such as statistical debugging, automated testing, or static bug detection. All lecture slides and references are available at http://www.whyprogramsfail.com.
If you are looking specifically for scientific publications of my group, see the delta debugging home page at http://www.st.cs.uni-sb.de/dd.
Finally, a web search on "delta debugging" will point you to a variety of resources, including further publications and implementations.