Luis Desde Canada's questions

I wanted to know if it is possible, and how it is done, to loop over groups of a Pandas dataframe. I have a text file, which I import with Pandas:

file= ("E:\Test.txt")
df = pd.read_csv(file, sep=';', dtype='str')
df

This gives me the following information:

      Fecha      ID   Alum Par  Nombre  Codigo  Descrip Cantidad    Tiempo
0   09/03/2021  A935    809 00  CARMEN  660192  Hard Disk   1   2
1   09/03/2021  A935    809 00  CARMEN  660412  Floppy  25  1.5
2   09/03/2021  A935    809 00  CARMEN  660475  SSD 1   3
3   09/03/2021  A217    800 00  CONCEPCION  661070  DVD 1   15
4   09/03/2021  A217    800 00  CONCEPCION  662734  CD  3   36
5   09/03/2021  A218    801 00  ELVIRA  660192  Hard Disk   1   2
6   09/03/2021  A232    909 16  LORENZO 660343  Ata Disk    1   2
7   09/03/2021  A232    909 16  LORENZO 660475  SSD 1   3

the first column being the index.

Since I am interested in grouping it by ID, I apply the following code:

gb = df.groupby(['ID'])
for k, gp in gb:
   print ('key=' + str(k))
   print (gp)

with which I reach the groups that interest me, and that helps me to see how many rows each 'ID' has. The result is the following

key=A217
        Fecha    ID  Alum Par    Nombre  Codigo Descrip Cantidad Tiempo
3  09/03/2021  A217   800  00  CONCEPCION  661070     DVD        1     15
4  09/03/2021  A217   800  00  CONCEPCION  662734      CD        3     36
key=A218
        Fecha    ID Socio Par  Nombre  Codigo    Descrip Cantidad Tiempo
5  09/03/2021  A218   801  00  ELVIRA  660192  Hard Disk        1      2
key=A232
        Fecha    ID Socio Par   Nombre  Codigo   Descrip Cantidad Tiempo
6  09/03/2021  A232   909  16  LORENZO  660343  Ata Disk        1      2
7  09/03/2021  A232   909  16  LORENZO  660475       SSD        1      3
key=A935
        Fecha    ID Socio Par  Nombre  Codigo    Descrip Cantidad Tiempo
0  09/03/2021  A935   809  00  CARMEN  660192  Hard Disk        1      2
1  09/03/2021  A935   809  00  CARMEN  660412     Floppy       25    1.5
2  09/03/2021  A935   809  00  CARMEN  660475        SSD        1      3

My query is how I can iterate within the groups in order to have this information easier to see for each group (ID):

   Resumen
   El 'Alum', 'Nombre', tiene 'Cantidad' de 'Descrip'.
   Fin  

Where you would have to have 1 line per group line. Is there a way to iterate within each group in Pandas? Any suggestion is welcome. From already thank you very much.

I'm trying to get Python to search for me certain lines (and slices) of a text file.

The text is as follows (the first 60 lines of 13000):

Linea 0     A     213992,"A     114416","05/01/2021","19/01/2021","N","E","1005","*                             "," 0"," 0","   0"," 0"," 0", 
Linea 1     A     114416,"CIOTOLO NORMA TELMA                     ","*                                                 ","POLA 1438                     ","CAPITAL                       ","4682-1534                     "," 74","F","1041","*                                                 ","   0","          ","     ","17/01/2013","17/01/2013","1202","15052545070100                ","DNI", 
Linea 2     C,"3755162        ","01/05/1938","*                             ","2","*      ", 
Linea 3     G   
Linea 4     A     213992,"            ","            ","                    ","                    ","                    ", 
Linea 5     13
Linea 6      1      475I 1
Linea 7      2      941I 1
Linea 8      3      190I 1
Linea 9      4      192I 1
Linea 10     5      412I 1
Linea 11     6     4811I 1
Linea 12     7      865I 1
Linea 13     8      867I 1
Linea 14     9      902I 1
Linea 15    10     8298I 1
Linea 16    11      546I 1
Linea 17    12      711I 1
Linea 18    13      120N 1
Linea 19    A     213993,"A     129320","05/01/2021","12/01/2021","N","E","1005","*                             "," 0"," 0","   0"," 0"," 0", 
Linea 20    A     129320,"LOPREITO ALICIA MIRTA                   ","*                                                 ","PIEDRABUENA 3841              ","CAPITAL                       ","4601-5620  1150631906         "," 73","F","   0","DNI 5694842                                       ","   0","          ","     ","05/01/2021","05/01/2021","1005","15046761690600                ","DNI", 
Linea 21    C,"5694842        ","11/10/1947","*                             ","2","*      ", 
Linea 22    G   
Linea 23    A     213993,"            ","            ","                    ","                    ","                    ", 
Linea 24    12
Linea 25     1      475I 1
Linea 26     2      653I 1
Linea 27     3      746I 1
Linea 28     4      133I 1
Linea 29     5      192I 1
Linea 30     6      362I 1
Linea 31     7      412I 1
Linea 32     8     4811I 1
Linea 33     9      546I 1
Linea 34    10      902I 1
Linea 35    11      948I 1
Linea 36    12      120N 1
Linea 37    A     214012,"A     129321","04/01/2021","18/01/2021","N","E","1005","*                             "," 0"," 0","   0"," 0"," 0", 
Linea 38    A     129321,"SERRANO MARIA DOLORES                   ","*                                                 ","LARRAZABAL 1551               ","CAPITAL                       ","1123101950                    "," 86","F","   0","DNI 16561081                                      ","   0","          ","     ","04/01/2021","04/01/2021","1005","15053746050100                ","DNI", 
Linea 39    C,"16561081       ","02/03/1934","*                             ","2","*      ", 
Linea 40    G   
Linea 41    A     214012,"            ","            ","                    ","                    ","                    ", 
Linea 42    11
Linea 43     1      475I 1
Linea 44     2      192I 1
Linea 45     3      297I 1
Linea 46     4      412I 1
Linea 47     5     4811I 1
Linea 48     6      546I 1
Linea 49     7      865I 1
Linea 50     8      866I 1
Linea 51     9      867I 1
Linea 52    10      500I 1
Linea 53    11     8298I 1
Linea 54    A     214013,"A     125271","04/01/2021","13/01/2021","N","E","1005"," 136                          "," 0"," 0","   0"," 0"," 0", 
Linea 55    A     125271,"IMPRENTA MIGUEL ARTURO                  ","*                                                 ","P.GARCIA 5887                 ","CAPITAL                       ","4605-5813                     "," 69","M"," 136","DNI 6151369                                       ","   0","          ","     ","27/10/2017","27/10/2017","1005","15060320150300                ","DNI", 
Linea 56    C,"6151369        ","01/11/1948","*                             ","2","*      ", 
Linea 57    G   
Linea 58    A     214013,"            ","            ","                    ","                    ","                    ", 
Linea 59    2
Linea 60     1      412I 1
Linea 61     2      500I 1

You must take information from lines 0,1 and 2

which should give this result:

DATA
CIATTLO MARIA TELMA;DNI;3666162;;;;;;;;;;01/05/1900;F;;;05/01/2021;158888450701;00;;;;;;;;

The code so far is:

with open ("E:\Test.txt", "r") as f:

     linea = f.readlines()



     def persona(linea):


      data = []                       # Lista con los campos a mostrar en una línea
      data.append(linea[1][16:49].rstrip())         # Nombre y Apellido
      data.append(linea[1][375:378])                # Tipo Documento
      data.append(linea[2][5:20].replace(" ", ""))  # Nro Documento
      data.append(";;;;;;;;")
      data.append(linea[2][23:33])                  # Fecha de Nacimiento
      data.append(linea[1][217:218])                # Sexo
      data.append(";")
      data.append(linea[0][31:41])                  # fecha
      data.append(linea[1][342:354])                # Beneficio
      data.append(linea[1][354:356])                # Parentesco
      data.append(";;;;;;;")
  
      print(";".join(data))

print("DATA") 
persona(linea)

I don't know how to add the same information to lines 19, 20 and 21, and 37, 38 and 39, and so on, of the 13,000 lines of the file.

The key to know which are the next 3 lines to read is the sum of the value of line 5 (in this case 13) + 6 (which are the lines with information). The result for this example would be:

DATA
CIATTLO MARIA TELMA;DNI;3666162;;;;;;;;;;01/05/1900;F;;;05/01/2021;158888450701;00;;;;;;;;
LOPEZITO ALACIA MIRNA;DNI;5688842;;;;;;;;;;11/10/1900;F;;;05/01/2021;150646464906;00;;;;;;;;
SICRANO MARIA DOLORES;DNI;16001081;;;;;;;;;;02/03/1900;F;;;04/01/2021;150538888501;00;;;;;;;;
IMPARNTA MIGUEL ARTURO;DNI;6152269;;;;;;;;;;01/11/1900;M;;;04/01/2021;150669691503;00;;;;;;;;

Thanks for the help.

I have a txt file with about 13000 lines, I'm importing them and when I want to make a loop to create a file with the information reordered as I need, I can't get it to work.

The file information is similar to this (the part with the line number is added for reference, it is not originally in the file):

Linea 0:    A     213992,"A     114416","05/01/2021","19/01/2021","N","E","1005","*                             "," 0"," 0","   0"," 0"," 0", \n
Linea 1:    A     114416,"Nombre 1                     ","*                                                 ","Address 1                     ","CAPITAL                       ","4682551534                     "," 74","F","1041","*                                                 ","   0","          ","     ","17/01/2013","17/01/2013","1202","1505254500070100                ","DNI", \n
Linea 2:    C,"37111662        ","01/05/1938","*                             ","2","*      ", \n
Linea 3:    G   
Linea 4:    A     213992,"            ","            ","                    ","                    ","                    ", 
Linea 5:    13
Linea 6:     1      475I 1
Linea 7:     2      941I 1
Linea 8:     3      190I 1
Linea 9:     4      192I 1
Linea 10:    5      412I 1
Linea 11:    6     4811I 1
Linea 12:    7      865I 1
Linea 13:    8      867I 1
Linea 14:    9      902I 1
Linea 15:   10     8298I 1
Linea 16:   11      546I 1
Linea 17:   12      711I 1
Linea 18:   13      120N 1
Linea 19:   A     213993,"A     129320","05/01/2021","12/01/2021","N","E","1005","*                             "," 0"," 0","   0"," 0"," 0", 
Linea 20:   A     129320,"Nombre 2                   ","*                                                 ","Address 2              ","CAPITAL                       ","4601555620  11531906         "," 73","F","   0","DNI 5564842                                       ","   0","          ","     ","05/01/2021","05/01/2021","1005","1504600761690600                ","DNI", 
Linea 21:   C,"569456742        ","11/10/1947","*                             ","2","*      ", 
Linea 22:   G   
Linea 23:   A     213993,"            ","            ","                    ","                    ","                    ", 
Linea 24:   12
Linea 25:    1      475I 1
Linea 26:    2      653I 1
Linea 27:    3      746I 1
Linea 28:    4      133I 1
Linea 29:    5      192I 1
Linea 30:    6      362I 1
Linea 31:    7      412I 1
Linea 32:    8     4811I 1
Linea 33:    9      546I 1
Linea 34:   10      902I 1
Linea 35:   11      948I 1
Linea 36:   12      120N 1
Linea 37:   A     214012,"A     129321","04/01/2021","18/01/2021","N","E","1005","*                             "," 0"," 0","   0"," 0"," 0", 
Linea 38:   A     129321,"Nombre 3                   ","*                                                 ","Address 3               ","CAPITAL                       ","1123101950                    "," 86","F","   0","DNI 16561081                                      ","   0","          ","     ","04/01/2021","04/01/2021","1005","1505370046050100                ","DNI", 
Linea 39:   C,"16561       ","02/03/1934","*                             ","2","*      ", 
Linea 40:   G   
Linea 41:   A     214012,"            ","            ","                    ","                    ","                    ", 
Linea 42:   11
Linea 43:    1      475I 1
Linea 44:    2      192I 1
Linea 45:    3      297I 1
Linea 46:    4      412I 1
Linea 47:    5     4811I 1
Linea 48:    6      546I 1
Linea 49:    7      865I 1
Linea 50:    8      866I 1
Linea 51:    9      867I 1
Linea 52:   10      500I 1
Linea 53:   11     8298I 1
Linea 54:   A     214013,"A     125271","04/01/2021","13/01/2021","N","E","1005"," 136                          "," 0"," 0","   0"," 0"," 0", 
Linea 55:   A     125271,"Nombre 4                  ","*                                                 ","Address 4                 ","CAPITAL                       ","4605-5813                     "," 69","M"," 136","DNI 6151369                                       ","   0","          ","     ","27/10/2017","27/10/2017","1005","1506000320150300                ","DNI", 
Linea 56:   C,"61546369        ","01/11/1948","*                             ","2","*      ", 
Linea 57:   G   
Linea 58:   A     214013,"            ","            ","                    ","                    ","                    ", 
Linea 59:   2
Linea 60:    1      412I 1
Linea 61:    2      500I 1

From line 0 I need element 0 and 2, from line 1 field 1, from line 2 field 16 to that I concatenate 475 from l6. This has to be done the number of times that line 5 says .

There you have to start again with the process in line 19 (which would become 0) and thus go through the 13000 lines...

The result should be:

A213992,05/01/2021,070100      ,  ,Nombre 1                     ","*,475
A213992,05/01/2021,070100      ,  ,Nombre 1                     ","*,941
A213992,05/01/2021,070100      ,  ,Nombre 1                     ","*,190
A213992,05/01/2021,070100      ,  ,Nombre 1                     ","*,192
A213992,05/01/2021,070100      ,  ,Nombre 1                     ","*,412
A213992,05/01/2021,070100      ,  ,Nombre 1                     ","*,4811
A213992,05/01/2021,070100      ,  ,Nombre 1                     ","*,865
A213992,05/01/2021,070100      ,  ,Nombre 1                     ","*,867
A213992,05/01/2021,070100      ,  ,Nombre 1                     ","*,902
A213992,05/01/2021,070100      ,  ,Nombre 1                     ","*,8298
A213992,05/01/2021,070100      ,  ,Nombre 1                     ","*,546
A213992,05/01/2021,070100      ,  ,Nombre 1                     ","*,711
A213992,05/01/2021,070100      ,  ,Nombre 1                     ","*,120
A213992,05/01/2021,070100      ,  ,Nombre 2                     ","*,475
A213992,05/01/2021,070100      ,  ,Nombre 2                     ","*,653
A213992,05/01/2021,070100      ,  ,Nombre 2                     ","*,746

But Name 1 should be about 13 lines (q is variable, and is what defines the number of lines to print per Name), there it should jump to Name 2 recalculating the r0(initial line) and putting the substrings of the first 3 lines concatenated with the q lines that follow.

Surely there is an easier way to do it than the loop I did and it doesn't work, and that is the following:

with open ("E:\SkyDrive\A Files\A Files\LACVI\Datos LABSYS\PROT2101 test - COPY.txt", "r") as filename:

   lines = filename.readlines()

cantidad=len(lines)  


r0 = 0
q = int(lines[r0+5])
t = r0 + 6
print (q , t)

while r0 < r0+q+t:

   linea1 = lines[r0]
   r0 = r0+1
   linea2 = lines[r0]
   r0 = r0+5
   linea3 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea3[4:12].strip(), sep=",")
linea4 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea4[4:12].strip(), sep=",")
linea5 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea5[4:12].strip(), sep=",")
linea6 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea6[4:12].strip(), sep=",")
linea7 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea7[4:12].strip(), sep=",")
linea8 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea8[4:12].strip(), sep=",")
linea9 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea9[4:12].strip(), sep=",")
linea10 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea10[4:12].strip(), sep=",")
linea11 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea11[4:12].strip(), sep=",")
linea12 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea12[4:12].strip(), sep=",")
linea13 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea13[4:12].strip(), sep=",")
linea14 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea14[4:12].strip(), sep=",")
linea15 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea15[4:12].strip(), sep=",")
linea16 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea16[4:12].strip(), sep=",")
linea17 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea17[4:12].strip(), sep=",")
linea18 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea18[4:12].strip(), sep=",")
linea19 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea19[4:12].strip(), sep=",")
linea20 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea20[4:12].strip(), sep=",")
linea21 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea21[4:12].strip(), sep=",")
linea22 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea22[4:12].strip(), sep=",")
linea23 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea23[4:12].strip(), sep=",")
linea24 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea24[4:12].strip(), sep=",")
linea25 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea25[4:12].strip(), sep=",")
linea26 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea26[4:12].strip(), sep=",")
linea27 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea27[4:12].strip(), sep=",")
linea28 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea28[4:12].strip(), sep=",")
linea29 = lines[r0]
   r0 = r0+1
   print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea29[4:12].strip(), sep=",")
linea30 = lines[r0]
  r0 = r0+1
  print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea30[4:12].strip(), sep=",")
linea31 = lines[r0]
  print(linea1[1:13].replace(" ", ""),linea1[31:41],linea2[342:354],linea2[354:356],linea2[16:50].rstrip(),linea31[4:12].strip(), sep=",")

   r0=q+7
   print(r0)
   break'''

I don't know if there is an easier way to create the lines to print (for now it's the one I found), I'm just starting out and I don't understand why the loop doesn't work.