Large tmp_XXXX Files Under a VOB’s sdft Folder

During a recent VOB restore I performed, I noticed that the VOB storage pool (the sdft subfolder) contains several large files, prefixed with tmp_ (for example, myvob.vbs/s/sdft/10/1d/tmp_3996.1)

Turns out these are called ‘unreferenced containers’, or ‘debris’.

Continue reading

Remove Problematic ClearCase Views

This handy little Perl script removes all traces of a view which is irremovable via conventional means – e.g. when the view storage is missing or inaccessible.

The script is design to run on UNIX in an interop environment, but can be easily be adjusted to other cases.

## Usage: perl <region> <view tag>
$region = $ARGV[0];
$region || die "Region must be specified!";
$tag = $ARGV[1];
$tag || die "View tag must be specified!";
## Detect view UUID
@uuid = `cleartool lsview -l -region $region $tag`;
foreach (@uuid)
  if (/View uuid/)
    s/View uuid: //;
    $uuid = $_;
# Remove the tag from the registry
system "cleartool rmtag -view -region $region $tag";
# Unregister the view
system "cleartool unreg -view -uuid $uuid";
# Remove view-related records from all VOBs
system "cleartool rmview -all -uuid $uuid";

Reference: Removing a view

Sporadic Cleartext Errors using Samba

A few months ago we migrated to a new VOB server (we have a Solaris/Windows inter-op, Samba-based environment). The transition went smoothly and all seemed well.

Suddenly, after a month or so, some of our users started having problems accessing some files. It all seemed very random, and it was slowly spreading.

In the view log we saw numerous cleartext-related errors:

2012-05-01T12:37:15+03:00 view_server(3124): Error: view_server.exe(3124): Error: Unable to construct cleartext for object "0x96E3D" in VOB "atlas:/disk02/algotec_vobs/3rdparty.vbs
": error detected by ClearCase subsystem
2012-05-01T12:37:15+03:00 view_server(3124): Error: view_server.exe(3124): Error: Type manager "z_whole_copy" failed construct_version operation.
2012-05-01T12:37:15+03:00 view_server(3124): Warning: z_whole_copy: Error: Can't open input file "\\atlas\disk02\algotec_vobs\3rdparty.vbs\s/sdft\e/28/3-6c7f92d47de9400a948cc3a7b52
3a9f9-fb" - Invalid argument

In the samba log we saw the following errors:

[2012/05/01 15:29:15,  1] libads/kerberos_verify.c:442                  
  ads_verify_ticket: krb5_init_context failed (Too many open files)     
[2012/05/01 15:29:15,  1] smbd/sesssetup.c:342(reply_spnego_kerberos)   
  Failed to verify incoming ticket with error NT_STATUS_LOGON_FAILURE!

Since I couldn’t find anything useful in IBM Rational Support website, or via Google, I contacted IBM Technical Support. After several back-and-forth emails, we nailed the problem. Turns out it wasn’t server-side at all!

The affected users were all using a relatively new PC, all installed from the same image. There were two things wrong with this image:

  1. The CLEARCASE_PRIMARY_GROUP environment variable was not defined.
  2. The ‘maximum mnodes’ value in the MVFS Performance configuration was set to 800 (suitable for 64-bit Samba) instead of 200 (suitable for 32-bit Samba, which we use).

After fixing this configuration, the problem was gone and everyone was happy again. Quite a challenge, it was…

Helpful link: Determine if a UNIX or Linux application is 32-bit or 64-bit