Talk:List of unit testing frameworks

Page contents not supported in other languages.
From Wikipedia, the free encyclopedia

xUnit[edit]

What is the difference between this article and the xUnit article? -- nolandda

Not all of these frameworks are xUnit. --Chris Pickett 05:59, 3 December 2006 (UTC)[reply]

What qualifies something as following the xUnit framework? The RUnit package for R appears to follow the architecture laid out on the xUnit page, but here it says it doesn't. I'm no expert, so I'm wondering whether this is a mistake. 128.174.127.111 (talk) 17:11, 1 March 2013 (UTC)[reply]

I'm guessing that categorizing a framework as xUnit is subjective. What does it mean to be xUnit? Is it derived-from, based-on, consistent-with, similar-to...? I think such categorization falls into a wide grey line. ... This list article classifies whether each framework is xUnit in a column described as "xUnit: This column indicates whether a framework should be considered of xUnit type." Begs the question: according to who or what authority? IMO the classification is more nonsense than valuable. Stevebroshar (talk) 11:21, 16 April 2024 (UTC)[reply]

Layout: Tables[edit]

I converted (then IP) the bullet-list page to a big number of small tables. The point was that then you have a TOC and can click on your language. Could we discuss the pros and cons of One-big-table versus Many-small-tables? --User77764 13:04, 3 December 2006 (UTC)[reply]

Another reason for many small tables is that I want to introduce columns to the C++ table which don't make sense anywhere else. --User77764 13:11, 3 December 2006 (UTC)[reply]

And to be able to do this, I will revert to the many tables version. This is no final decision of course. --User77764 13:31, 3 December 2006 (UTC)[reply]

Yet another idea: There are many languages with only one framework listed. Maybe combine them all into a single table while those languages with multiple entries get tables of their own? --User77764 16:33, 3 December 2006 (UTC)[reply]

That will make it annoying if and when new frameworks crop up, it should be all the same style I think. So many smaller tables is fine, if somewhat more cumbersome to maintain when adding a new category to each table. I was thinking one big table for the columns that can be common between languages, and smaller tables for the columns particular to a language, but then you have to maintain the list of frameworks in two places. So many smaller tables then, but add the xUnit column to all of them. I wish table-editing was wysiwyg, would make life easier. --Chris Pickett 17:54, 3 December 2006 (UTC)[reply]
OK, so we go for one table per language... maybe add all columns that are explained at the top to all tables? --User77764 18:08, 3 December 2006 (UTC)[reply]
Sure... and it seems better if the common columns in each table go before the language-specific ones, with the exception of Remarks. --Chris Pickett 18:42, 3 December 2006 (UTC)[reply]
Ack. --User77764 20:31, 3 December 2006 (UTC)[reply]

Expansion[edit]

The list needs information. White boxes mean: We do not know. Anybody with sufficient knowledge please help out. Also, more columns should be added where appropriate. --User77764 14:58, 5 December 2006 (UTC)[reply]

In the PHP category, Code Igniter is a "Web Application Framework" so even if it contains a Unit test suite, it seems to be in a wrong place. 193.49.124.107 15:25, 25 April 2007 (UTC)[reply]

Add QtUnit? Based on CppUnit. -- pne (talk) 09:49, 5 November 2007 (UTC)[reply]

Regarding language dialects[edit]

The language list surely is too long. Recently an entry for Symbian was added. Now this is clearly NO language, is it? Afaik, they use C++ in some flavor. Anyways, they don't deserve an own entry. Where to place such candidates? --User77764 17:49, 15 December 2006 (UTC)[reply]

I wasn't sure about that one either. You could merge it with C++, but is it really a C++ framework? What other ones did you want to merge? Chris Pickett 20:19, 15 December 2006 (UTC)[reply]
Hmm, Transact-SQL and SQL? I don't know, most of the languages are unknown to me... (but I know more than one of them ;-) ) --User77764 18:28, 19 December 2006 (UTC)[reply]
I think we should just leave it. If you can find an example where compilers for either one will happily accept the other, then sure, merge to the same language. Chris Pickett 11:18, 21 December 2006 (UTC)[reply]
Well, I still think the list (of languages!) is too long. But then, the "article" lacks in more important areas, for sure. --User77764 00:28, 23 December 2006 (UTC)[reply]

Specify Visual Basic 6 (VB6)[edit]

I assume that the "Visual Basic" heading refers to Visual Basic Ver. 6, or at least I think it should. Visual Basic Ver. 6, a.k.a. "VB6", is of course quite distinct from VB .NET; the latter which I expect should be included under the ".NET programming languages" heading. So my suggestions: (1) change "Visual Basic" heading to "Visual Basic Ver. 6 (VB6)", and (2) remove csUnit entry from the VB6 group. csUnit already appears under the .NET programming languages, which it seems is correct -- from what I can tell, csUnit only supports .NET and does not support VB6. --Nmarler 16:42, 29 April 2007 (UTC)[reply]

Emacs Lisp[edit]

The link for the ELisp unit testing package times out - is this link broken? Autarch 20:27, 9 November 2007 (UTC)[reply]

The link was indeed broken, as the server said the file didn't exist today. I added a link to the appropriate page as well as adding a link to another Elisp unit testing package. Autarch 16:24, 12 November 2007 (UTC)[reply]

QTestLib[edit]

Qt (toolkit) includes QTestLib. It should be on the list, but I'm not sure about the properties. --Ropez (talk) 12:50, 21 February 2008 (UTC)[reply]

GLSL[edit]

Why is UnitTestCg listed as supporting GLSL? It does not say so on the Google Code page, or anywhere at all. I believe that the author might have mixed it up with HLSL. --193.77.149.126 (talk) 07:08, 17 December 2008 (UTC)[reply]

Fortran unit testing framework missing[edit]

What about pFunit? [1]

ANTLR[edit]

gUnit - ANTLR grammar testing [2] —Preceding unsigned comment added by Seaswiki (talk • contribs) 23:45, 24 December 2009 (UTC)[reply]

Google mocking framework is not a testing framework[edit]

What is it doing here? Also, Google Testing framework does not provide mocks - it uses google's Mocking framework to do that. Plus, it doesn't support exceptions in so far as that when one occurs when you don't specify it the entire testing framework falls over. —Preceding unsigned comment added by 82.210.249.81 (talk) 09:30, 7 May 2010 (UTC)[reply]

UnitTest++ not xUnit like?[edit]

According to the Wikipedia page, UnitTest++ has all the required features for being considered xUnit like, yet it's listed as a "no". —Preceding unsigned comment added by 82.210.249.81 (talk) 09:32, 7 May 2010 (UTC)[reply]

Wiki link validity[edit]

Many test frameworks have common names, so putting a wiki link to general page isn't helpful (eg. Fact, Specter and Pex). 99.237.58.158 (talk) 20:29, 22 May 2010 (UTC)[reply]

Distinction between unit testing and mocking[edit]

The distinction between a "unit testing framework" and a "mock framework" ought to be explained somewhere. Unit testing is often explained with nice examples in which unit testing suffice. This is fine as far as introducing unit testing goes. In my personal experience, unit testing does not make much sense without mocking support. —Preceding unsigned comment added by 142.169.202.4 (talk) 14:14, 22 July 2010 (UTC)[reply]

That seems silly. Mocks are only useful when you are trying to "unit test" a component that by all rights should be covered by an integration test. Grauenwolf (talk) 06:41, 7 May 2012 (UTC)[reply]

Time for a HEAVY trimming[edit]

This list is already in WP:LINKFARM territory, and it isn't its only problem, as it also violates WP:LSC: if a complete list would include hundreds of entries, then you should use the notability standard to provide focus to the list.

Therefore, my suggestion here is to:

  1. First, remove every entry without an article (solves LSC)
  2. Then, remove the "Homepage" column as the external links would be provided by the wikilinked articles. (solves LINKFARM)

--M4gnum0n (talk) 16:31, 24 July 2012 (UTC)[reply]

Linkfarm, yes. SpamLinks, no. In other, similar lists, links to product details pages or FAQ are supplied in their own column. That is what these should be converted to since they do not have refs. Also, other lists only have notable products, and by notable I mean, products with articles on Wikipedia. That is not a requirement on Wikipedia as M4gnum0n suggests, but it is a discussion point. I don't think this list would benefit from such pruning. --Walter Görlitz (talk) 16:35, 24 July 2012 (UTC)[reply]
I don't really think the pruning is a discussion point, as the current state of the list contradicts my direct quotation of a guideline above. --M4gnum0n (talk) 17:18, 24 July 2012 (UTC)[reply]
Thanks for sharing your opinion. I don't think that those guidelines apply here. --Walter Görlitz (talk) 18:08, 24 July 2012 (UTC)[reply]
Then let's wait for a few days and see if something moves. --M4gnum0n (talk) 09:03, 25 July 2012 (UTC)[reply]
OK, more than one week passed and no one chimed in. This led me to refer to the Dispute resolution policy, which I found somewhat confusing. If I read that correctly, it seems that the choice is between WP:3O, WP:DRN and WP:RFC. What do you think the right process should be? --M4gnum0n (talk) 11:05, 2 August 2012 (UTC)[reply]
Third opinion is not binding and usually a waste of time particularly when someone who knows little chimes in. It's better just to go for an RFC. But I would like to reiterate, this isn't a link farm since there is additional information provided for most entries and so it is not a "'mere collection of external links or Internet directories". And as for selection criteria, not all are "supported by reliable sources". --Walter Görlitz (talk) 14:01, 9 August 2012 (UTC)[reply]

RfC on trimming[edit]

Should this list only contain items that already have an article? M4gnum0n (talk) 09:49, 17 August 2012 (UTC)[reply]

  • No because there is information provided about the entries aside from the item's name which makes more than a mere collection, it adds value to the material to allow for comparison of the items. It also classifies them. While not all entries entry currently meet notability criteria for articles, entries have been verified, and it is reasonable to expect an article could be forthcoming in the future. This list is not too large to be useful to readers since it is grouped into smaller sections. --Walter Görlitz (talk) 14:06, 17 August 2012 (UTC)[reply]
  • No, if the items are important to the scope of the article, it should not matter whether they are notable enough to have their own article. To offer an analogy, a scientific paper or study may not be important enough to warrant its own article, but could be mentioned in the article concerning its field of study. Silvrous (talk) 15:28, 2 September 2012 (UTC)[reply]
    • Comment Silvrous' comments are against several guidelines such as WP:LINKFARM. Sorry, but that doesn't change the fact that the list is useful. --Walter Görlitz (talk) 23:30, 2 September 2012 (UTC)[reply]
  • No. Even if there were any merit to the criterion, it would not be relevant. WP rules are supposed to be aimed at constructiveness, not smugly rule-bound constipation. If it makes sense to refer to something in a reasonable context and good sense, as long as it is reasonably verifiable, in it goes. As for WG's comment, point(s) taken, but a more helpful lede should deal with such objections adequately, even if it does little beyond referring helpfully to the parent article. JonRichfield (talk) 03:08, 8 September 2012 (UTC)[reply]
"WP rules are supposed to be aimed at constructiveness, not smugly rule-bound constipation. " {{citation-needed}} Andy Dingley (talk) 08:19, 8 September 2012 (UTC)[reply]
My apologies; your challenge id obviously unanswerable. I shall invest in a cork immediately. JonRichfield (talk) 09:49, 8 September 2012 (UTC)[reply]

xUnit.net[edit]

I think that the remarks is not exact: from the license of NUNIT [license of NUNIT|http://nunit.org/index.php?p=license&r=2.6.2] i deduce that the creator is Philip A. Craig, in 2000. James W. Newkirk, the creator of xUnit.net, appears in the licence from 2002 to 2004. I think also that the [reference|http://stackoverflow.com/questions/261139/nunit-vs-mbunit-vs-mstest-vs-xunit-net] is not the most adecuate: i do not understand how it is posible deduce "xUnit.net is currently the highest rated .NET unit testing framework" from a Q/A, where, in this case, all the answers are personal opinions of the users. Maybe you can take as an indicator, but is a weak probe for an afirmation. — Preceding unsigned comment added by Narkha (talk • contribs) 11:55, 9 September 2013 (UTC)[reply]

utPLSQL[edit]

I am the current administrator of the utPLSQL project (I became involved in about September 2013). It is true that the project was dormant for a time, but over the last year or so, there have been a number of releases (http://utplsql.sourceforge.net/Doc/release.html) and the ticket trackers are maintained and responded to. I don't know if that's enough for it to be listed as "active" on this page? 90.208.0.226 (talk) 10:53, 21 March 2015 (UTC)[reply]

External links modified January 2016[edit]

Hello fellow Wikipedians,

I have just added archive links to 9 external links on List of unit testing frameworks. Please take a moment to review my edit. If necessary, add {{cbignore}} after the link to keep me from modifying it. Alternatively, you can add {{nobots|deny=InternetArchiveBot}} to keep me off the page altogether. I made the following changes:

When you have finished reviewing my changes, please set the checked parameter below to true to let others know.

checkY An editor has reviewed this edit and fixed any errors that were found.

  • If you have discovered URLs which were erroneously considered dead by the bot, you can report them with this tool.
  • If you found an error with any archives or the URLs themselves, you can fix them with this tool.

Cheers.—cyberbot IITalk to my owner:Online 01:29, 12 January 2016 (UTC)[reply]

External links modified 13 February 2016[edit]

Hello fellow Wikipedians,

I have just added archive links to 2 external links on List of unit testing frameworks. Please take a moment to review my edit. If necessary, add {{cbignore}} after the link to keep me from modifying it. Alternatively, you can add {{nobots|deny=InternetArchiveBot}} to keep me off the page altogether. I made the following changes:

When you have finished reviewing my changes, please set the checked parameter below to true to let others know.

checkY An editor has reviewed this edit and fixed any errors that were found.

  • If you have discovered URLs which were erroneously considered dead by the bot, you can report them with this tool.
  • If you found an error with any archives or the URLs themselves, you can fix them with this tool.

Cheers.—cyberbot IITalk to my owner:Online 18:17, 13 February 2016 (UTC)[reply]

External links modified 29 February 2016[edit]

Hello fellow Wikipedians,

I have just added archive links to one external link on List of unit testing frameworks. Please take a moment to review my edit. If necessary, add {{cbignore}} after the link to keep me from modifying it. Alternatively, you can add {{nobots|deny=InternetArchiveBot}} to keep me off the page altogether. I made the following changes:

When you have finished reviewing my changes, please set the checked parameter below to true or failed to let others know (documentation at {{Sourcecheck}}).

☒N An editor has determined that the edit contains an error somewhere. Please follow the instructions below and mark the |checked= to true

  • If you have discovered URLs which were erroneously considered dead by the bot, you can report them with this tool.
  • If you found an error with any archives or the URLs themselves, you can fix them with this tool.

Cheers.—cyberbot IITalk to my owner:Online 09:07, 29 February 2016 (UTC)[reply]

External links modified March 2016[edit]

Hello fellow Wikipedians,

I have just added archive links to one external link on List of unit testing frameworks. Please take a moment to review my edit. If necessary, add {{cbignore}} after the link to keep me from modifying it. Alternatively, you can add {{nobots|deny=InternetArchiveBot}} to keep me off the page altogether. I made the following changes:

When you have finished reviewing my changes, please set the checked parameter below to true or failed to let others know (documentation at {{Sourcecheck}}).

checkY An editor has reviewed this edit and fixed any errors that were found.

  • If you have discovered URLs which were erroneously considered dead by the bot, you can report them with this tool.
  • If you found an error with any archives or the URLs themselves, you can fix them with this tool.

Cheers.—cyberbot IITalk to my owner:Online 04:11, 3 March 2016 (UTC)[reply]

Clarify meaning of table columns[edit]

Somebody please clarify the meaning of table columns. E.g. for the table for C++, what does the "Macros" column mean? Does it mean the framework has special logic to test macros? Does it mean test registration via macros? What about the "Generators" column? Does it mean the framework can generate (scaffold) test cases? A lot of these columns don't have obvious unambiguous meaning, even to those intimate to testing frameworks. How do we even know we are talking about the same thing across all frameworks? "Generator" may mean one thing to the developers/users of Boost Test, and a completely different thing to developers/users of Google Test. Without such clarifications, these tables are not really useful. — Preceding unsigned comment added by SwordAngel (talk • contribs) 15:06, 5 October 2016 (UTC)[reply]

External links modified[edit]

Hello fellow Wikipedians,

I have just modified 8 external links on List of unit testing frameworks. Please take a moment to review my edit. If you have any questions, or need the bot to ignore the links, or the page altogether, please visit this simple FaQ for additional information. I made the following changes:

When you have finished reviewing my changes, you may follow the instructions on the template below to fix any issues with the URLs.

checkY An editor has reviewed this edit and fixed any errors that were found.

  • If you have discovered URLs which were erroneously considered dead by the bot, you can report them with this tool.
  • If you found an error with any archives or the URLs themselves, you can fix them with this tool.

Cheers.—InternetArchiveBot (Report bug) 23:02, 23 May 2017 (UTC)[reply]

Internet section[edit]

I think it should be renamed to "Web programming" or "Client-side scripting". Galzigler (talk) 15:33, 9 November 2017 (UTC)[reply]

External links modified[edit]

Hello fellow Wikipedians,

I have just modified 27 external links on List of unit testing frameworks. Please take a moment to review my edit. If you have any questions, or need the bot to ignore the links, or the page altogether, please visit this simple FaQ for additional information. I made the following changes:

When you have finished reviewing my changes, you may follow the instructions on the template below to fix any issues with the URLs.

checkY An editor has reviewed this edit and fixed any errors that were found.

  • If you have discovered URLs which were erroneously considered dead by the bot, you can report them with this tool.
  • If you found an error with any archives or the URLs themselves, you can fix them with this tool.

Cheers.—InternetArchiveBot (Report bug) 05:34, 3 January 2018 (UTC)[reply]

More data[edit]

I like C. I'm overwhelmed by the quantity of frameworks available. I will expand the section about C. I will add columns listing the following columns:

  1. Source implementation (whether it is in C, C++, TCL, Python or JavaScript, extensions to C)
  2. Compiler requirements (GCC, Clang, MSVC, compiler-specific extensions)
  3. Runtime requirements (standard library, a extended standard library, POSIX or more)
  4. Operating system requirements (Linux or BSD specific features)
  5. Year of creation
  6. Notable projects that use it
  7. moar

Shining Button (talk) 18:29, 20 March 2024 (UTC)[reply]

Retrieved from "https://en.wikipedia.org/w/index.php?title=Talk:List_of_unit_testing_frameworks&oldid=1219210581"